2021-07-13T00:00:00.111Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=92e9d1bd-7ea8-44a4-b7c5-7f29106873a0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:00.512Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=92e9d1bd-7ea8-44a4-b7c5-7f29106873a0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=646 EndTimestamp=2021-07-13T00:00:00.512Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-12T23:59:59.866Z InvocationID=6d6d3ed5-ffa4-4d03-be53-5db37ee4ce37 ResponseDesc=OK 2021-07-13T00:00:02.864Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=38234a68-bf75-4749-9fd7-187929d9ed6e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:02.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:02.864Z InvocationID=938f418f-b5a4-4744-8ac2-019cc586b245 2021-07-13T00:00:03.056Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=38234a68-bf75-4749-9fd7-187929d9ed6e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:03.460Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=38234a68-bf75-4749-9fd7-187929d9ed6e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=596 EndTimestamp=2021-07-13T00:00:03.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:02.864Z InvocationID=3341d991-4dc3-473f-a154-006b6abc15d4 ResponseDesc=OK 2021-07-13T00:00:05.374Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eec42cac-86f1-41bb-a5ca-1d62ceff8aa5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:05.374Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:05.374Z InvocationID=6e82bf74-e877-44bc-a4f1-790838d20668 2021-07-13T00:00:05.559Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eec42cac-86f1-41bb-a5ca-1d62ceff8aa5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:05.758Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eec42cac-86f1-41bb-a5ca-1d62ceff8aa5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=383 EndTimestamp=2021-07-13T00:00:05.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:05.374Z InvocationID=c9348331-3728-438e-9527-4b595643e0a3 ResponseDesc=OK 2021-07-13T00:00:07.443Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a8ab4ed6-0355-443c-9628-9be54bada7bc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:07.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:07.443Z InvocationID=55f31e96-ac59-431f-9ca0-d2872acedf4b 2021-07-13T00:00:07.812Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a8ab4ed6-0355-443c-9628-9be54bada7bc InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:08.211Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a8ab4ed6-0355-443c-9628-9be54bada7bc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=768 EndTimestamp=2021-07-13T00:00:08.211Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:07.443Z InvocationID=2e58a24f-e7e0-4c01-a244-d120b780bd67 ResponseDesc=OK 2021-07-13T00:00:08.873Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=44d4c8ff-2fc6-4fe0-8a8a-6e68130fc2a6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:08.873Z InvocationID=3a494dac-294e-4773-a53d-ac47ab2dfce4 2021-07-13T00:00:09.057Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=44d4c8ff-2fc6-4fe0-8a8a-6e68130fc2a6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:09.273Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d7aec10-dfda-4e29-848b-58ede27a9b66 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:09.272Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:09.272Z InvocationID=72a4515e-f41f-41e1-bb74-a45b796957a3 2021-07-13T00:00:09.460Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=44d4c8ff-2fc6-4fe0-8a8a-6e68130fc2a6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=587 EndTimestamp=2021-07-13T00:00:09.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:08.873Z InvocationID=2e17136d-a8a6-4d44-b0ea-63901231e430 ResponseDesc=OK 2021-07-13T00:00:09.462Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d7aec10-dfda-4e29-848b-58ede27a9b66 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:09.757Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2d7aec10-dfda-4e29-848b-58ede27a9b66 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=485 EndTimestamp=2021-07-13T00:00:09.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:09.272Z InvocationID=97f6098f-d8d4-4523-a555-cb5309dcf7fa ResponseDesc=OK 2021-07-13T00:00:11.960Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=241fd5d6-e6aa-4653-a21e-0a20f40ad94a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:11.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:11.960Z InvocationID=22c8ba83-8aad-4aab-8263-f4d1f990428b 2021-07-13T00:00:12.511Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=241fd5d6-e6aa-4653-a21e-0a20f40ad94a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:12.912Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=241fd5d6-e6aa-4653-a21e-0a20f40ad94a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=951 EndTimestamp=2021-07-13T00:00:12.911Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:11.960Z InvocationID=0f56c944-9eba-41fd-8779-ef2a5619dba6 ResponseDesc=OK 2021-07-13T00:00:15.270Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81e14c85-d3ad-450a-9409-79c784699d57 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:15.270Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:15.270Z InvocationID=f4a80bfa-1154-4950-9a4d-e90c2a58dfcd 2021-07-13T00:00:15.457Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81e14c85-d3ad-450a-9409-79c784699d57 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:15.763Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=81e14c85-d3ad-450a-9409-79c784699d57 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=493 EndTimestamp=2021-07-13T00:00:15.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:15.270Z InvocationID=a8b39edb-d118-4289-9cc5-10f1ac5acec8 ResponseDesc=OK 2021-07-13T00:00:17.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=58a4fedc-a040-4fdd-b229-51ba34d87f18 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:17.439Z InvocationID=0d703285-92b4-47fc-b012-543b101b4056 2021-07-13T00:00:18.369Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=58a4fedc-a040-4fdd-b229-51ba34d87f18 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:18.658Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=58a4fedc-a040-4fdd-b229-51ba34d87f18 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1218 EndTimestamp=2021-07-13T00:00:18.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:17.439Z InvocationID=f2ef889b-eec1-488f-bd64-9e381c30183c ResponseDesc=OK 2021-07-13T00:00:18.873Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8ef1a56e-14d0-428a-ab4f-c65439e37607 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:18.873Z InvocationID=05a08f0f-ed0a-414b-900d-9576c160d43a 2021-07-13T00:00:18.961Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d62ab3a9-47a2-44dd-a63e-64e0c8c9745d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:18.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:18.961Z InvocationID=48ad2216-8e6f-4376-91a1-8bf36bff1e1a 2021-07-13T00:00:19.061Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d62ab3a9-47a2-44dd-a63e-64e0c8c9745d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:19.117Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8ef1a56e-14d0-428a-ab4f-c65439e37607 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:19.417Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d62ab3a9-47a2-44dd-a63e-64e0c8c9745d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=456 EndTimestamp=2021-07-13T00:00:19.417Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:18.961Z InvocationID=2365db3e-5149-459c-974d-8a1911e0c03c ResponseDesc=OK 2021-07-13T00:00:19.460Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8ef1a56e-14d0-428a-ab4f-c65439e37607 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=587 EndTimestamp=2021-07-13T00:00:19.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:18.873Z InvocationID=090d2925-9745-4236-8157-f8ff417f7d54 ResponseDesc=OK 2021-07-13T00:00:20.771Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5aef4b6b-4723-49a5-b33c-31b4c4d3d1d2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:20.771Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:20.771Z InvocationID=cba817e4-a59c-4ce2-9e0e-478fc9e21cee 2021-07-13T00:00:20.959Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5aef4b6b-4723-49a5-b33c-31b4c4d3d1d2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:21.363Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5aef4b6b-4723-49a5-b33c-31b4c4d3d1d2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=592 EndTimestamp=2021-07-13T00:00:21.363Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:20.771Z InvocationID=7e0697cb-a78c-4dcb-92f8-c967874ae1ee ResponseDesc=OK 2021-07-13T00:00:23.868Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8c2e0a06-6a39-47f3-bb44-afd697e283ae InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:23.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:23.868Z InvocationID=c58931de-f199-4424-8570-4200f79d681e 2021-07-13T00:00:24.365Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8c2e0a06-6a39-47f3-bb44-afd697e283ae InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:24.712Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8c2e0a06-6a39-47f3-bb44-afd697e283ae InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=844 EndTimestamp=2021-07-13T00:00:24.712Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:23.868Z InvocationID=87dfb00a-584b-45f6-9b19-5e5e8d639060 ResponseDesc=OK 2021-07-13T00:00:27.069Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4ea5b307-d255-4714-89c2-793a803067d9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:27.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:27.069Z InvocationID=df874334-c9d3-48d5-8951-152864e9d079 2021-07-13T00:00:27.258Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4ea5b307-d255-4714-89c2-793a803067d9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:27.439Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=906c7e27-7e77-4a92-85a6-7f09992ee7e9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:27.439Z InvocationID=1d772f4e-0f97-417d-a45a-f2fa76dded80 2021-07-13T00:00:27.564Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=906c7e27-7e77-4a92-85a6-7f09992ee7e9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:27.659Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4ea5b307-d255-4714-89c2-793a803067d9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=590 EndTimestamp=2021-07-13T00:00:27.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:27.069Z InvocationID=eae95d4f-b8b5-4dbf-9092-2bdf2d5a1e6d ResponseDesc=OK 2021-07-13T00:00:27.757Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=906c7e27-7e77-4a92-85a6-7f09992ee7e9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=318 EndTimestamp=2021-07-13T00:00:27.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:27.439Z InvocationID=7111a182-faf1-42a5-975e-04c1f6e920eb ResponseDesc=OK 2021-07-13T00:00:28.873Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dc732b45-fd31-47a0-988b-8844b393e5a1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:28.873Z InvocationID=266552e5-daaa-437a-9910-5f81078b62a2 2021-07-13T00:00:29.320Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dc732b45-fd31-47a0-988b-8844b393e5a1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:29.712Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dc732b45-fd31-47a0-988b-8844b393e5a1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=839 EndTimestamp=2021-07-13T00:00:29.712Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:28.873Z InvocationID=0bdc4664-9bd4-45be-89a5-4b72968e892b ResponseDesc=OK 2021-07-13T00:00:29.763Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=42a42660-fcc4-4b9b-b152-0ee9ac54462f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:29.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:29.763Z InvocationID=e09bb1e1-6c37-4f42-9c50-645ee0843077 2021-07-13T00:00:29.956Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=42a42660-fcc4-4b9b-b152-0ee9ac54462f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:30.760Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=42a42660-fcc4-4b9b-b152-0ee9ac54462f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=996 EndTimestamp=2021-07-13T00:00:30.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:29.763Z InvocationID=59691d80-958f-4a1d-a0aa-5bdbde193e11 ResponseDesc=OK 2021-07-13T00:00:33.174Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=01325c0f-ad83-4af7-90c6-0dc1060e4538 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:33.174Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:33.174Z InvocationID=08c0126b-e0e7-4fde-99b9-58034ea15e9a 2021-07-13T00:00:33.359Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=01325c0f-ad83-4af7-90c6-0dc1060e4538 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:33.557Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=01325c0f-ad83-4af7-90c6-0dc1060e4538 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=383 EndTimestamp=2021-07-13T00:00:33.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:33.174Z InvocationID=42d1f80c-7c60-45af-933e-020004eaf51f ResponseDesc=OK 2021-07-13T00:00:36.472Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=494d065b-3df2-4d40-9367-e1cc865a75d8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:36.472Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:36.472Z InvocationID=98ad2d98-4556-48bc-b923-af3a4c63ca2a 2021-07-13T00:00:36.711Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=494d065b-3df2-4d40-9367-e1cc865a75d8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:37.440Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=df3cd958-7bd6-40d4-a97b-1364256a6b0c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:37.440Z InvocationID=0c6b8ca4-1647-4eb4-9a3a-5e027a01d1e2 2021-07-13T00:00:37.557Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=df3cd958-7bd6-40d4-a97b-1364256a6b0c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:37.713Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=494d065b-3df2-4d40-9367-e1cc865a75d8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1241 EndTimestamp=2021-07-13T00:00:37.713Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:36.472Z InvocationID=39dc95b9-3a8c-4670-9a24-c3e05a613242 ResponseDesc=OK 2021-07-13T00:00:37.866Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=df3cd958-7bd6-40d4-a97b-1364256a6b0c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=425 EndTimestamp=2021-07-13T00:00:37.865Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:37.440Z InvocationID=df1ceeb7-d4c8-4cbe-8d81-cb69bef7deaa ResponseDesc=OK 2021-07-13T00:00:38.777Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cc007825-e1f4-4611-afb4-eb3cb8b7648e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:38.777Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:38.777Z InvocationID=c231bdda-31ae-42fc-9d96-844cb4da2d2c 2021-07-13T00:00:38.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ee91d444-0ae8-4377-96cf-39e26dd40230 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:38.873Z InvocationID=5835c4a9-e405-47cd-a016-de7227c13909 2021-07-13T00:00:38.959Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cc007825-e1f4-4611-afb4-eb3cb8b7648e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:39.056Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ee91d444-0ae8-4377-96cf-39e26dd40230 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:39.257Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ee91d444-0ae8-4377-96cf-39e26dd40230 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=384 EndTimestamp=2021-07-13T00:00:39.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:38.873Z InvocationID=45e05488-69c8-44ed-a494-b9d443e7aa46 ResponseDesc=OK 2021-07-13T00:00:39.514Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cc007825-e1f4-4611-afb4-eb3cb8b7648e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=737 EndTimestamp=2021-07-13T00:00:39.514Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:38.777Z InvocationID=59e7cbc0-4d02-42cb-bb8d-616ce8bad0bf ResponseDesc=OK 2021-07-13T00:00:41.782Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=adf1af02-8666-428f-be6d-2e35780217e8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:41.782Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:41.782Z InvocationID=dc7ccb8a-23a6-426a-8e8b-a4bd3b446fe7 2021-07-13T00:00:41.957Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=adf1af02-8666-428f-be6d-2e35780217e8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:42.259Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=adf1af02-8666-428f-be6d-2e35780217e8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=477 EndTimestamp=2021-07-13T00:00:42.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:41.782Z InvocationID=99f05006-055c-461b-8b91-40c7a15edc78 ResponseDesc=OK 2021-07-13T00:00:45.172Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ac236db1-1443-4362-9ef7-e9c661ad8ba3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:45.172Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:45.172Z InvocationID=431de2f6-1858-4938-8bcc-096170281387 2021-07-13T00:00:45.360Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ac236db1-1443-4362-9ef7-e9c661ad8ba3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:45.557Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ac236db1-1443-4362-9ef7-e9c661ad8ba3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=385 EndTimestamp=2021-07-13T00:00:45.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:45.172Z InvocationID=fd2ec202-8ecc-43e6-8620-babbb6fdae07 ResponseDesc=OK 2021-07-13T00:00:47.442Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=016648aa-7108-4322-8aca-d711bc7b3c86 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:47.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:47.442Z InvocationID=39aef9fb-a251-4db7-bb69-144a8673d409 2021-07-13T00:00:47.965Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=181a34ce-e5f7-4339-8ebf-c39f8c69b30b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:47.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:47.964Z InvocationID=55450d1b-7d03-487a-b3f1-636107998c2f 2021-07-13T00:00:48.117Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=016648aa-7108-4322-8aca-d711bc7b3c86 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:48.159Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=181a34ce-e5f7-4339-8ebf-c39f8c69b30b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:48.430Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=016648aa-7108-4322-8aca-d711bc7b3c86 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=988 EndTimestamp=2021-07-13T00:00:48.430Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:47.442Z InvocationID=4892ef9a-8567-438c-a4af-02353cde35e9 ResponseDesc=OK 2021-07-13T00:00:48.561Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=181a34ce-e5f7-4339-8ebf-c39f8c69b30b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=596 EndTimestamp=2021-07-13T00:00:48.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:47.964Z InvocationID=c78592a1-b579-45f7-821b-c3e98799e427 ResponseDesc=OK 2021-07-13T00:00:48.877Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6442adb9-a56b-41b6-acf3-e39d1bd90b65 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:48.877Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:48.877Z InvocationID=3088b7cb-9089-41a4-a51c-319fd641dff4 2021-07-13T00:00:49.059Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6442adb9-a56b-41b6-acf3-e39d1bd90b65 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:49.257Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6442adb9-a56b-41b6-acf3-e39d1bd90b65 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=380 EndTimestamp=2021-07-13T00:00:49.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:48.877Z InvocationID=68837f0c-ae40-4be1-a30e-6b1a33bfd542 ResponseDesc=OK 2021-07-13T00:00:50.867Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81ab60a5-8afa-4596-bcef-cf485079e20c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:50.867Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:50.867Z InvocationID=c127b7d6-0df8-4f13-8178-73d9d510c047 2021-07-13T00:00:51.117Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81ab60a5-8afa-4596-bcef-cf485079e20c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:51.612Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=81ab60a5-8afa-4596-bcef-cf485079e20c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=745 EndTimestamp=2021-07-13T00:00:51.612Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:50.867Z InvocationID=810cefa6-c350-4f49-8acc-0b66aec7d6a9 ResponseDesc=OK 2021-07-13T00:00:53.872Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a911fee9-8b0a-4b91-bf71-f6965594e29b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:53.872Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:53.872Z InvocationID=7e65a54a-c2b9-479f-98d4-264530360539 2021-07-13T00:00:54.757Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a911fee9-8b0a-4b91-bf71-f6965594e29b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:55.059Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a911fee9-8b0a-4b91-bf71-f6965594e29b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1187 EndTimestamp=2021-07-13T00:00:55.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:53.872Z InvocationID=49d09b20-8053-4d71-9eee-7af1c439a76d ResponseDesc=OK 2021-07-13T00:00:56.767Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ab55f174-41d2-483c-b4b6-43fc41f5e54a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:56.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:56.767Z InvocationID=3ec3a744-1405-4af8-82ca-eee56c9949ec 2021-07-13T00:00:57.059Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ab55f174-41d2-483c-b4b6-43fc41f5e54a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:57.257Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ab55f174-41d2-483c-b4b6-43fc41f5e54a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=490 EndTimestamp=2021-07-13T00:00:57.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:56.767Z InvocationID=de226ff0-dba1-48f0-af33-1489fc39e0a0 ResponseDesc=OK 2021-07-13T00:00:57.441Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=356f85dd-8e78-4290-b265-b9e724588fa2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:57.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:57.441Z InvocationID=b848e863-cc6d-480d-969a-5a29335d82b5 2021-07-13T00:00:57.712Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=356f85dd-8e78-4290-b265-b9e724588fa2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:58.112Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=356f85dd-8e78-4290-b265-b9e724588fa2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=671 EndTimestamp=2021-07-13T00:00:58.112Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:57.441Z InvocationID=5e36ab0e-54cd-409c-941f-2a34c4d06584 ResponseDesc=OK 2021-07-13T00:00:58.873Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31d5c5f9-015c-4d5f-94d3-08b42c0c0d7b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:00:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:58.873Z InvocationID=db631c0e-e77c-442a-859a-2cfef3cd84c5 2021-07-13T00:00:59.157Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31d5c5f9-015c-4d5f-94d3-08b42c0c0d7b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:00:59.561Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31d5c5f9-015c-4d5f-94d3-08b42c0c0d7b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=688 EndTimestamp=2021-07-13T00:00:59.561Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:00:58.873Z InvocationID=864b8b93-6c37-4e18-ad36-8807e749f27e ResponseDesc=OK 2021-07-13T00:01:00.164Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=044f0534-4ca0-499a-9825-103cfdc60302 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:00.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:00.164Z InvocationID=b8609597-58c5-4ce9-b82c-bb80a0143afd 2021-07-13T00:01:00.259Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=044f0534-4ca0-499a-9825-103cfdc60302 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:00.557Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=044f0534-4ca0-499a-9825-103cfdc60302 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=393 EndTimestamp=2021-07-13T00:01:00.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:00.164Z InvocationID=192e31db-5fba-4b9c-a4d0-d659cb1c0368 ResponseDesc=OK 2021-07-13T00:01:02.876Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=90095aed-1c96-4988-b544-af6d45a52e7b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:02.876Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:02.876Z InvocationID=8ccb345a-c753-451f-bd27-8f56a91a5604 2021-07-13T00:01:03.113Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=90095aed-1c96-4988-b544-af6d45a52e7b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:03.512Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=90095aed-1c96-4988-b544-af6d45a52e7b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=636 EndTimestamp=2021-07-13T00:01:03.512Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:02.876Z InvocationID=41f784b2-197e-47f1-89cc-d2537ea8be21 ResponseDesc=OK 2021-07-13T00:01:05.976Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=06f4a2b2-f381-48f6-ba33-c4bfbafdc4c2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:05.976Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:05.976Z InvocationID=c83d8e01-5c1a-432d-b622-7d382850fd10 2021-07-13T00:01:06.156Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=06f4a2b2-f381-48f6-ba33-c4bfbafdc4c2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:06.562Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=06f4a2b2-f381-48f6-ba33-c4bfbafdc4c2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=586 EndTimestamp=2021-07-13T00:01:06.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:05.976Z InvocationID=183756a5-8267-4129-8188-527b8aacfc10 ResponseDesc=OK 2021-07-13T00:01:07.445Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3027c90a-e456-4755-ae36-fbfbb6c864ca InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:07.445Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:07.445Z InvocationID=101958ac-d275-4a30-bf60-77132fe5e6dc 2021-07-13T00:01:07.559Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3027c90a-e456-4755-ae36-fbfbb6c864ca InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:07.757Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3027c90a-e456-4755-ae36-fbfbb6c864ca InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=312 EndTimestamp=2021-07-13T00:01:07.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:07.445Z InvocationID=899cd5db-ce0c-470a-896e-6af25f6d5b19 ResponseDesc=OK 2021-07-13T00:01:08.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b1667046-3920-41dc-8026-6f6274355fb0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:08.873Z InvocationID=dd3c38a7-88fc-4bf5-b4a5-57f8e326c863 2021-07-13T00:01:08.961Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2139d586-2eda-4c52-b358-7f4978c2e193 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:08.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:08.961Z InvocationID=b70872aa-b89d-4e81-bc33-3e0b1752f865 2021-07-13T00:01:09.059Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2139d586-2eda-4c52-b358-7f4978c2e193 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:09.211Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b1667046-3920-41dc-8026-6f6274355fb0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:09.412Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2139d586-2eda-4c52-b358-7f4978c2e193 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=451 EndTimestamp=2021-07-13T00:01:09.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:08.961Z InvocationID=17ff1812-754e-4cb2-927d-77fc790951b9 ResponseDesc=OK 2021-07-13T00:01:09.660Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b1667046-3920-41dc-8026-6f6274355fb0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=787 EndTimestamp=2021-07-13T00:01:09.660Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:08.873Z InvocationID=29b86420-0d33-4536-869b-83c33fa28313 ResponseDesc=OK 2021-07-13T00:01:12.064Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e4b76f1c-7897-47fc-be16-b32887591bb3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:12.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:12.064Z InvocationID=1501132b-16c7-4390-a38e-c24ca6de516e 2021-07-13T00:01:12.258Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e4b76f1c-7897-47fc-be16-b32887591bb3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:12.457Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e4b76f1c-7897-47fc-be16-b32887591bb3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=393 EndTimestamp=2021-07-13T00:01:12.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:12.064Z InvocationID=8bd0b93e-a458-4fdc-a63a-48792a0b4685 ResponseDesc=OK 2021-07-13T00:01:14.764Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=13eb68ce-aecb-4e39-88c8-616775309f44 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:14.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:14.764Z InvocationID=a930a3a1-13df-44d8-a9e4-45feedda278e 2021-07-13T00:01:14.917Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=13eb68ce-aecb-4e39-88c8-616775309f44 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:15.312Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=13eb68ce-aecb-4e39-88c8-616775309f44 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=548 EndTimestamp=2021-07-13T00:01:15.312Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:14.764Z InvocationID=5c9086cc-2000-494f-91d0-003c2c1ac786 ResponseDesc=OK 2021-07-13T00:01:17.440Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b616c1a5-ea0e-4343-a45f-1688a2141a4d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:17.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:17.440Z InvocationID=20a7b2c2-5c28-46c6-9513-0bc7ecb44e45 2021-07-13T00:01:17.566Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b616c1a5-ea0e-4343-a45f-1688a2141a4d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:17.777Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dd33db4a-e10b-417a-9639-68a9fcde91b5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:17.777Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:17.777Z InvocationID=256f92c3-9d3c-4df4-b409-1c2dca8bc77c 2021-07-13T00:01:17.960Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dd33db4a-e10b-417a-9639-68a9fcde91b5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:17.960Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b616c1a5-ea0e-4343-a45f-1688a2141a4d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=520 EndTimestamp=2021-07-13T00:01:17.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:17.440Z InvocationID=6ae9998a-ad50-48a1-bd04-bd59fc12cc61 ResponseDesc=OK 2021-07-13T00:01:18.158Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dd33db4a-e10b-417a-9639-68a9fcde91b5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=381 EndTimestamp=2021-07-13T00:01:18.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:17.777Z InvocationID=37a3955b-e2ee-409d-8e61-892af3d74ddd ResponseDesc=OK 2021-07-13T00:01:18.873Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3a725d93-ac6b-4b5e-a913-a4b9ac270608 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:18.873Z InvocationID=e67260e2-4788-4c24-be0a-8636b479770c 2021-07-13T00:01:18.960Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3a725d93-ac6b-4b5e-a913-a4b9ac270608 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:19.059Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3a725d93-ac6b-4b5e-a913-a4b9ac270608 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=186 EndTimestamp=2021-07-13T00:01:19.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:18.873Z InvocationID=7612c3c1-34d5-4401-b49a-176d5d08b674 ResponseDesc=OK 2021-07-13T00:01:21.174Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=406f05b7-aa7e-407f-96bb-27de87678ad6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:21.174Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:21.174Z InvocationID=82f42ebe-0ae8-40b5-abe4-83165ae0ca05 2021-07-13T00:01:21.368Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=406f05b7-aa7e-407f-96bb-27de87678ad6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:21.760Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=406f05b7-aa7e-407f-96bb-27de87678ad6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=586 EndTimestamp=2021-07-13T00:01:21.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:21.174Z InvocationID=e9d7ff1e-dbcd-4f16-a108-619645cf5fbb ResponseDesc=OK 2021-07-13T00:01:23.859Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c0cef9d4-3e4c-4d58-9af5-82078d4c0db5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:23.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:23.859Z InvocationID=08241e99-efc8-4e56-9b41-9540c5e873dc 2021-07-13T00:01:23.960Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c0cef9d4-3e4c-4d58-9af5-82078d4c0db5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:24.158Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c0cef9d4-3e4c-4d58-9af5-82078d4c0db5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=299 EndTimestamp=2021-07-13T00:01:24.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:23.859Z InvocationID=845de9c4-9da3-435f-9d9a-c1b1eb23954b ResponseDesc=OK 2021-07-13T00:01:26.865Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=70b80f27-1705-4487-9bd1-74ea33ec54b5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:26.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:26.865Z InvocationID=09400e29-8595-484d-b4cd-a105e7a7a22b 2021-07-13T00:01:27.112Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=70b80f27-1705-4487-9bd1-74ea33ec54b5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:27.440Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=68125a39-3716-427a-b38d-4eb6bfa5881a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:27.440Z InvocationID=ec6f9bae-c566-48db-b07d-27c6257e07c9 2021-07-13T00:01:27.515Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=70b80f27-1705-4487-9bd1-74ea33ec54b5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=650 EndTimestamp=2021-07-13T00:01:27.515Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:26.865Z InvocationID=af104e58-6619-447c-94ba-8e7e13f6dbd4 ResponseDesc=OK 2021-07-13T00:01:27.556Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=68125a39-3716-427a-b38d-4eb6bfa5881a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:27.960Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=68125a39-3716-427a-b38d-4eb6bfa5881a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=520 EndTimestamp=2021-07-13T00:01:27.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:27.440Z InvocationID=3537b157-859a-4e2e-ba1a-7fd1d4b21f60 ResponseDesc=OK 2021-07-13T00:01:28.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=83c7bc40-8208-4ecb-92fe-a0452a35d648 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:28.873Z InvocationID=fec98627-cc07-42db-bb2b-4295552e30f5 2021-07-13T00:01:28.970Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=83c7bc40-8208-4ecb-92fe-a0452a35d648 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:29.164Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=83c7bc40-8208-4ecb-92fe-a0452a35d648 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=291 EndTimestamp=2021-07-13T00:01:29.164Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:28.873Z InvocationID=1f0b6737-622e-4490-b36a-e4c08f0cea11 ResponseDesc=OK 2021-07-13T00:01:30.163Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7b08fa9a-c917-47a0-a321-aed9e75d59a7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:30.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:30.163Z InvocationID=026f8292-8099-4ec2-a749-1fbd9e40dc9c 2021-07-13T00:01:31.414Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7b08fa9a-c917-47a0-a321-aed9e75d59a7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:31.827Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7b08fa9a-c917-47a0-a321-aed9e75d59a7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1664 EndTimestamp=2021-07-13T00:01:31.827Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:30.163Z InvocationID=381c1529-67de-40d1-9bf5-afb35e4063fc ResponseDesc=OK 2021-07-13T00:01:33.063Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0b7908d8-e41d-4235-a2bc-60184f2cbf74 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:33.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:33.062Z InvocationID=0b759276-0c86-49e4-a51a-2f1751a100cf 2021-07-13T00:01:33.256Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0b7908d8-e41d-4235-a2bc-60184f2cbf74 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:33.660Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0b7908d8-e41d-4235-a2bc-60184f2cbf74 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=598 EndTimestamp=2021-07-13T00:01:33.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:33.062Z InvocationID=5f314d8e-cee0-4029-bcd2-33c3f03c8bdb ResponseDesc=OK 2021-07-13T00:01:36.068Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=13950044-a9a2-4cea-93b5-d8389f08a4bc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:36.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:36.068Z InvocationID=58a62f42-b837-4613-a75b-a17cee25eb5c 2021-07-13T00:01:36.259Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=13950044-a9a2-4cea-93b5-d8389f08a4bc InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:36.458Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=13950044-a9a2-4cea-93b5-d8389f08a4bc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=390 EndTimestamp=2021-07-13T00:01:36.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:36.068Z InvocationID=d8030774-5f8b-4ee7-a396-2afdab827159 ResponseDesc=OK 2021-07-13T00:01:37.439Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=33d4ce89-8f1c-4d40-bf95-e07992ab3b71 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:37.439Z InvocationID=9ad2c95c-a025-46e5-8ec7-81af0c6c2920 2021-07-13T00:01:37.564Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=33d4ce89-8f1c-4d40-bf95-e07992ab3b71 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:37.917Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=33d4ce89-8f1c-4d40-bf95-e07992ab3b71 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=477 EndTimestamp=2021-07-13T00:01:37.916Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:37.439Z InvocationID=56f19be2-f153-48ac-8bdf-431f599b98a8 ResponseDesc=OK 2021-07-13T00:01:38.678Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=284437f7-bc7f-4884-8df0-a58906221b14 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:38.678Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:38.678Z InvocationID=c0da49a5-1438-46f7-8b1f-bc74b0ebafb1 2021-07-13T00:01:38.857Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=284437f7-bc7f-4884-8df0-a58906221b14 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:38.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5c0d1f3d-11e7-4ab5-935b-dc9e3832146d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:38.873Z InvocationID=42237809-629f-450c-adb4-d0dacd29a54d 2021-07-13T00:01:38.963Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5c0d1f3d-11e7-4ab5-935b-dc9e3832146d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:39.160Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5c0d1f3d-11e7-4ab5-935b-dc9e3832146d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=287 EndTimestamp=2021-07-13T00:01:39.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:38.873Z InvocationID=6944ef17-4153-47d9-ad20-fa2494c14d51 ResponseDesc=OK 2021-07-13T00:01:39.257Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=284437f7-bc7f-4884-8df0-a58906221b14 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=579 EndTimestamp=2021-07-13T00:01:39.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:38.678Z InvocationID=b7b5420e-746d-4a9d-9675-a4c44c68751c ResponseDesc=OK 2021-07-13T00:01:41.966Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e41b0c1-0a81-48be-bee1-538dc0b63db0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:41.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:41.965Z InvocationID=a4c75cf6-e403-452a-a8a0-1bbd3fb35bc5 2021-07-13T00:01:42.212Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e41b0c1-0a81-48be-bee1-538dc0b63db0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:42.612Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e41b0c1-0a81-48be-bee1-538dc0b63db0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=647 EndTimestamp=2021-07-13T00:01:42.612Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:41.965Z InvocationID=5fbef9a3-35a2-4845-a8eb-a9ab66aab001 ResponseDesc=OK 2021-07-13T00:01:44.976Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=26c8edf0-4cc1-4188-bd59-6998a015e86f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:44.976Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:44.976Z InvocationID=b4d468f2-8df5-42f0-b2a1-9e5881481c1c 2021-07-13T00:01:45.156Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=26c8edf0-4cc1-4188-bd59-6998a015e86f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:45.660Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=26c8edf0-4cc1-4188-bd59-6998a015e86f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=684 EndTimestamp=2021-07-13T00:01:45.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:44.976Z InvocationID=dfedc861-34d3-4ec7-8112-13b9263f3239 ResponseDesc=OK 2021-07-13T00:01:47.440Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eb5bbf81-94b1-4862-a8b9-a47bf6f5e9fc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:47.440Z InvocationID=d3e99b9c-e0fe-4706-8679-3b5267b3c9e7 2021-07-13T00:01:47.658Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eb5bbf81-94b1-4862-a8b9-a47bf6f5e9fc InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:47.858Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eb5bbf81-94b1-4862-a8b9-a47bf6f5e9fc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=418 EndTimestamp=2021-07-13T00:01:47.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:47.440Z InvocationID=67ea5fdb-8882-487a-adea-ff13ece49b53 ResponseDesc=OK 2021-07-13T00:01:48.362Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=599327b6-47f3-4232-98a1-7e975573000f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:48.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:48.362Z InvocationID=ec38c20b-28f4-48d5-b0af-ba8c10e7fa02 2021-07-13T00:01:48.611Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=599327b6-47f3-4232-98a1-7e975573000f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:48.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f3ed7975-e9b5-40de-9399-2e2a9dfddb05 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:48.874Z InvocationID=f196b85c-318c-445c-bc64-ff1643901b20 2021-07-13T00:01:49.062Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f3ed7975-e9b5-40de-9399-2e2a9dfddb05 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:49.112Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=599327b6-47f3-4232-98a1-7e975573000f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=750 EndTimestamp=2021-07-13T00:01:49.112Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:48.362Z InvocationID=164fd56f-fdd6-4557-9290-a9ba8cd2d3f9 ResponseDesc=OK 2021-07-13T00:01:49.460Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f3ed7975-e9b5-40de-9399-2e2a9dfddb05 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=585 EndTimestamp=2021-07-13T00:01:49.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:48.874Z InvocationID=b2cac491-7e0b-42b8-ab72-525026205aa0 ResponseDesc=OK 2021-07-13T00:01:50.864Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d4d75b97-6bb7-4573-99b0-80c50ad37e1f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:50.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:50.864Z InvocationID=f5934754-6e35-4487-b01c-395f371e8291 2021-07-13T00:01:51.059Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d4d75b97-6bb7-4573-99b0-80c50ad37e1f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:51.257Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d4d75b97-6bb7-4573-99b0-80c50ad37e1f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=393 EndTimestamp=2021-07-13T00:01:51.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:50.864Z InvocationID=e107734b-f896-4577-af31-0a78ea870751 ResponseDesc=OK 2021-07-13T00:01:53.871Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6322715b-80f8-4774-b4a5-99dd99310167 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:53.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:53.871Z InvocationID=bebf2355-26c2-4c6b-9fb0-620c91a5b183 2021-07-13T00:01:54.017Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6322715b-80f8-4774-b4a5-99dd99310167 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:54.412Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6322715b-80f8-4774-b4a5-99dd99310167 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=541 EndTimestamp=2021-07-13T00:01:54.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:53.871Z InvocationID=8d76885c-4f67-4e2a-8ce1-31fd72d257d5 ResponseDesc=OK 2021-07-13T00:01:56.574Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e40f31b9-f7f5-4a29-aeec-78e7d710efab InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:56.574Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:56.574Z InvocationID=0fbaa05d-130d-4f8a-9891-042e5b621af3 2021-07-13T00:01:56.856Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e40f31b9-f7f5-4a29-aeec-78e7d710efab InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:57.174Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e40f31b9-f7f5-4a29-aeec-78e7d710efab InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=600 EndTimestamp=2021-07-13T00:01:57.174Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:56.574Z InvocationID=e42dd930-a024-4a7f-8584-95742471f466 ResponseDesc=OK 2021-07-13T00:01:57.439Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=93ebba25-fc25-4466-a34b-ea0ab15df2c0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:57.439Z InvocationID=07d2bd63-8aab-45c9-8145-cc32cf391f1f 2021-07-13T00:01:57.559Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=93ebba25-fc25-4466-a34b-ea0ab15df2c0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:57.757Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=93ebba25-fc25-4466-a34b-ea0ab15df2c0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=318 EndTimestamp=2021-07-13T00:01:57.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:57.439Z InvocationID=391aee3a-1751-4ace-b4ce-c7d9f5e8b83c ResponseDesc=OK 2021-07-13T00:01:58.873Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7dbc95f1-7864-476a-9a78-97d64b65aec7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:58.873Z InvocationID=b759d98d-3431-47ea-8f5f-13871a1ea593 2021-07-13T00:01:59.111Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7dbc95f1-7864-476a-9a78-97d64b65aec7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:01:59.516Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7dbc95f1-7864-476a-9a78-97d64b65aec7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=643 EndTimestamp=2021-07-13T00:01:59.516Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:58.873Z InvocationID=5ad594eb-8996-4cd6-8127-827ee7dcc669 ResponseDesc=OK 2021-07-13T00:01:59.769Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dff68874-defa-4037-93b3-2ab6fdd58445 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:01:59.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:59.769Z InvocationID=8b388ef3-a9aa-4272-af66-28b786d3968a 2021-07-13T00:01:59.957Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dff68874-defa-4037-93b3-2ab6fdd58445 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:00.360Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dff68874-defa-4037-93b3-2ab6fdd58445 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=590 EndTimestamp=2021-07-13T00:02:00.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:01:59.769Z InvocationID=f59fdaa0-329a-4ca5-9413-18a5215b547f ResponseDesc=OK 2021-07-13T00:02:02.768Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7bea8fb5-cb8f-4d75-9534-88439f287207 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:02.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:02.768Z InvocationID=9cf1d724-2f99-4878-8de4-f0075e405de9 2021-07-13T00:02:02.959Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7bea8fb5-cb8f-4d75-9534-88439f287207 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:03.357Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7bea8fb5-cb8f-4d75-9534-88439f287207 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=589 EndTimestamp=2021-07-13T00:02:03.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:02.768Z InvocationID=f372cd28-9b35-46dc-9fc5-c1191daa2137 ResponseDesc=OK 2021-07-13T00:02:06.064Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f0ad48e9-e0c2-49cf-95db-de9bfea719be InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:06.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:06.064Z InvocationID=15de9167-3a05-4dd9-962e-badd5f65b03e 2021-07-13T00:02:06.312Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f0ad48e9-e0c2-49cf-95db-de9bfea719be InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:06.712Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f0ad48e9-e0c2-49cf-95db-de9bfea719be InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=648 EndTimestamp=2021-07-13T00:02:06.712Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:06.064Z InvocationID=ea32dd13-82c7-4491-a126-a7f9e7e4fae6 ResponseDesc=OK 2021-07-13T00:02:07.439Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e565f46a-b547-4614-89b8-38437a4267f2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:07.439Z InvocationID=6bd62714-ad08-470d-b977-747dfb1abee7 2021-07-13T00:02:07.557Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e565f46a-b547-4614-89b8-38437a4267f2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:07.963Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e565f46a-b547-4614-89b8-38437a4267f2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=524 EndTimestamp=2021-07-13T00:02:07.963Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:07.439Z InvocationID=f1d95674-e4ac-433f-ab8e-365aea578a14 ResponseDesc=OK 2021-07-13T00:02:08.864Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=67a67eda-44b7-4869-acbe-45f0ea85178c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:08.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:08.864Z InvocationID=9992f426-5ad8-4595-a415-ee621d72736e 2021-07-13T00:02:08.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=635e454b-ed99-4e7d-84c2-79239b179fa3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:08.873Z InvocationID=9a0a02a4-3dc2-4c62-a90b-d9698533051f 2021-07-13T00:02:09.057Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=635e454b-ed99-4e7d-84c2-79239b179fa3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:09.058Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=67a67eda-44b7-4869-acbe-45f0ea85178c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:09.260Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=67a67eda-44b7-4869-acbe-45f0ea85178c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=395 EndTimestamp=2021-07-13T00:02:09.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:08.864Z InvocationID=497689b9-e1f9-402e-aa50-9e23ad28728f ResponseDesc=OK 2021-07-13T00:02:09.461Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=635e454b-ed99-4e7d-84c2-79239b179fa3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=588 EndTimestamp=2021-07-13T00:02:09.461Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:08.873Z InvocationID=d19c05f5-bf8b-4055-b5f7-813706b75fd1 ResponseDesc=OK 2021-07-13T00:02:12.365Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=813d63c7-0e94-4058-b653-a89faa4e3313 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:12.365Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:12.365Z InvocationID=9767ba9b-03aa-42ac-945b-4626854c4f7e 2021-07-13T00:02:12.556Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=813d63c7-0e94-4058-b653-a89faa4e3313 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:12.959Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=813d63c7-0e94-4058-b653-a89faa4e3313 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=594 EndTimestamp=2021-07-13T00:02:12.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:12.365Z InvocationID=7aba604d-583d-4c56-9111-d491e35e9416 ResponseDesc=OK 2021-07-13T00:02:14.767Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=506f10c8-f2f2-4715-b004-81f9d566b3b8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:14.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:14.767Z InvocationID=dd140b6d-c60c-4397-995a-9e5fa07c9e37 2021-07-13T00:02:14.867Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=506f10c8-f2f2-4715-b004-81f9d566b3b8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:14.968Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=506f10c8-f2f2-4715-b004-81f9d566b3b8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=201 EndTimestamp=2021-07-13T00:02:14.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:14.767Z InvocationID=3963d2d4-7b1b-4dc3-bca7-9f2bab6afe4c ResponseDesc=OK 2021-07-13T00:02:17.439Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce1940ae-b30f-4139-be3f-61d00adda512 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:17.439Z InvocationID=58674559-1c8e-42a5-aaa8-a334360a7927 2021-07-13T00:02:17.713Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce1940ae-b30f-4139-be3f-61d00adda512 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:18.169Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6b1f13e6-1ecf-4c9c-a0d8-65ae20a72fa8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:18.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:18.168Z InvocationID=7616ad55-1b2d-46cc-82cf-4295f4d47c52 2021-07-13T00:02:18.517Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ce1940ae-b30f-4139-be3f-61d00adda512 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1078 EndTimestamp=2021-07-13T00:02:18.517Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:17.439Z InvocationID=297d3ab7-d6ad-4106-8535-8de02113d68a ResponseDesc=OK 2021-07-13T00:02:18.557Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6b1f13e6-1ecf-4c9c-a0d8-65ae20a72fa8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:18.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9679516a-0438-4e7e-a2d6-e3e3512f3cb7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:18.873Z InvocationID=88d4abaa-b1d5-407d-8d68-4fd31ae84fcd 2021-07-13T00:02:18.963Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6b1f13e6-1ecf-4c9c-a0d8-65ae20a72fa8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=794 EndTimestamp=2021-07-13T00:02:18.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:18.168Z InvocationID=ced30cf6-9962-46ba-a48b-2b6903176a0c ResponseDesc=OK 2021-07-13T00:02:19.059Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9679516a-0438-4e7e-a2d6-e3e3512f3cb7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:19.266Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9679516a-0438-4e7e-a2d6-e3e3512f3cb7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=392 EndTimestamp=2021-07-13T00:02:19.265Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:18.873Z InvocationID=7ed99d90-defd-4052-a880-abf5899ba315 ResponseDesc=OK 2021-07-13T00:02:21.069Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7994da3d-b895-4500-8891-20d1a2a85c70 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:21.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:21.068Z InvocationID=5be5e533-25a5-467d-aa49-d5ec1f6b1189 2021-07-13T00:02:21.312Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7994da3d-b895-4500-8891-20d1a2a85c70 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:21.723Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7994da3d-b895-4500-8891-20d1a2a85c70 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=655 EndTimestamp=2021-07-13T00:02:21.723Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:21.068Z InvocationID=d5b4b720-f585-402c-9417-d9e4dc06953f ResponseDesc=OK 2021-07-13T00:02:23.778Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=50d4ef6c-533b-473f-bc89-ade550ff7d57 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:23.777Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:23.777Z InvocationID=5e8f9de8-1be9-429a-b64f-b0f46974c322 2021-07-13T00:02:23.957Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=50d4ef6c-533b-473f-bc89-ade550ff7d57 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:24.371Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=50d4ef6c-533b-473f-bc89-ade550ff7d57 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=594 EndTimestamp=2021-07-13T00:02:24.371Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:23.777Z InvocationID=e97a08d4-c658-4d3e-9470-1e2c04b0a7fe ResponseDesc=OK 2021-07-13T00:02:27.262Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=85f980f1-eb66-4647-86ac-4373320623f6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:27.262Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:27.262Z InvocationID=e2fd4ddb-07c4-4ac1-8b6f-640e169add1d 2021-07-13T00:02:27.359Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=85f980f1-eb66-4647-86ac-4373320623f6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:27.439Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7d20a179-e96d-4d70-8bcc-e0b33167659c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:27.439Z InvocationID=bcf5005b-a64a-4606-98e2-7cc9083acad4 2021-07-13T00:02:27.557Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=85f980f1-eb66-4647-86ac-4373320623f6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=295 EndTimestamp=2021-07-13T00:02:27.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:27.262Z InvocationID=73cb9d2c-98c8-4da9-8be6-e5bbf796240a ResponseDesc=OK 2021-07-13T00:02:27.712Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7d20a179-e96d-4d70-8bcc-e0b33167659c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:28.319Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7d20a179-e96d-4d70-8bcc-e0b33167659c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=880 EndTimestamp=2021-07-13T00:02:28.319Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:27.439Z InvocationID=1c4f8b4a-a419-4cb0-b824-7cc068fa35c1 ResponseDesc=OK 2021-07-13T00:02:28.873Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a439267e-213c-467e-a720-b786e5a7bb93 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:28.873Z InvocationID=68786da7-de34-4e48-932a-f0b108ac00a3 2021-07-13T00:02:29.057Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a439267e-213c-467e-a720-b786e5a7bb93 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:29.459Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a439267e-213c-467e-a720-b786e5a7bb93 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=586 EndTimestamp=2021-07-13T00:02:29.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:28.873Z InvocationID=f109da78-2785-4c50-9038-1044f44a1cd8 ResponseDesc=OK 2021-07-13T00:02:29.965Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9d41bb46-cb35-4d36-8b15-0a9c262798c2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:29.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:29.965Z InvocationID=0da0c3d5-62a5-4c18-92c6-c9035b879160 2021-07-13T00:02:30.059Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9d41bb46-cb35-4d36-8b15-0a9c262798c2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:30.358Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9d41bb46-cb35-4d36-8b15-0a9c262798c2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=392 EndTimestamp=2021-07-13T00:02:30.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:29.965Z InvocationID=6559bd5a-2b77-44c7-be57-c2e85428238b ResponseDesc=OK 2021-07-13T00:02:32.774Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eda743a1-1add-4481-b87e-0b56e3b91e12 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:32.774Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:32.774Z InvocationID=c972676d-d73f-4f5b-bf05-6c6125e219f8 2021-07-13T00:02:33.012Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eda743a1-1add-4481-b87e-0b56e3b91e12 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:33.412Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eda743a1-1add-4481-b87e-0b56e3b91e12 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=638 EndTimestamp=2021-07-13T00:02:33.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:32.774Z InvocationID=16167252-ef8c-4a02-a2c4-efc2094c8448 ResponseDesc=OK 2021-07-13T00:02:35.566Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b01e95ac-005b-4df1-83d4-a6abce3b04e4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:35.566Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:35.566Z InvocationID=548e64e1-4d61-45dc-a01b-f66199bd2bec 2021-07-13T00:02:35.756Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b01e95ac-005b-4df1-83d4-a6abce3b04e4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:36.160Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b01e95ac-005b-4df1-83d4-a6abce3b04e4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=593 EndTimestamp=2021-07-13T00:02:36.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:35.566Z InvocationID=a810bd02-d9d2-441a-bf41-449433d6a06b ResponseDesc=OK 2021-07-13T00:02:37.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c5f0bc18-06c9-43a5-9f62-cc77e6fe5f69 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:37.439Z InvocationID=59eea931-d0b6-4d0b-8b10-86608707f78e 2021-07-13T00:02:37.559Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c5f0bc18-06c9-43a5-9f62-cc77e6fe5f69 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:37.759Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c5f0bc18-06c9-43a5-9f62-cc77e6fe5f69 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=320 EndTimestamp=2021-07-13T00:02:37.759Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:37.439Z InvocationID=41555873-09cb-4879-9bd3-b7f0d0bec180 ResponseDesc=OK 2021-07-13T00:02:38.763Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2fa1557e-6d3c-429c-826d-6483ec675748 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:38.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:38.763Z InvocationID=79d6ec8a-b773-457c-af54-238f102fe94c 2021-07-13T00:02:38.873Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d1844c8d-2596-42b7-9e91-11214fb66413 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:38.873Z InvocationID=9bf60fd8-43a7-442c-8748-937ae7a174f5 2021-07-13T00:02:38.915Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2fa1557e-6d3c-429c-826d-6483ec675748 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:38.960Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d1844c8d-2596-42b7-9e91-11214fb66413 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:39.214Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2fa1557e-6d3c-429c-826d-6483ec675748 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=451 EndTimestamp=2021-07-13T00:02:39.214Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:38.763Z InvocationID=c628a87b-1785-43d9-b85f-4badd86f4c28 ResponseDesc=OK 2021-07-13T00:02:39.360Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d1844c8d-2596-42b7-9e91-11214fb66413 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=487 EndTimestamp=2021-07-13T00:02:39.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:38.873Z InvocationID=bcf3973a-98c2-4ea0-8aba-4981e5a5901c ResponseDesc=OK 2021-07-13T00:02:41.770Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=016ae18d-019e-4705-a3ff-9777003c2cdc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:41.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:41.770Z InvocationID=a403f1f4-ec1d-47f6-8bf0-9633ca422633 2021-07-13T00:02:41.959Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=016ae18d-019e-4705-a3ff-9777003c2cdc InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:42.160Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=016ae18d-019e-4705-a3ff-9777003c2cdc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=390 EndTimestamp=2021-07-13T00:02:42.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:41.770Z InvocationID=50fb882f-0428-4828-91c3-5b13b6ad1ee7 ResponseDesc=OK 2021-07-13T00:02:45.077Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fdbd6730-99a0-4f57-b2e5-cb35190f415c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:45.077Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:45.077Z InvocationID=c19c2be8-b7cb-45f6-98cf-2a814a02c74f 2021-07-13T00:02:45.316Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fdbd6730-99a0-4f57-b2e5-cb35190f415c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:45.559Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fdbd6730-99a0-4f57-b2e5-cb35190f415c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=482 EndTimestamp=2021-07-13T00:02:45.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:45.077Z InvocationID=cbdb2e98-f875-4c5b-b7c9-f19a2a6c685c ResponseDesc=OK 2021-07-13T00:02:47.443Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=564b45d6-79b0-4466-8b22-bdcf8366262d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:47.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:47.443Z InvocationID=2fd84280-e13e-4d69-9e1c-a8e3f270710f 2021-07-13T00:02:47.557Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=564b45d6-79b0-4466-8b22-bdcf8366262d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:47.666Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bd353d07-ea80-4f6f-95a9-124057a1d35a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:47.666Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:47.666Z InvocationID=2728ba2e-33d5-4498-bdc7-51fd3232a1d6 2021-07-13T00:02:47.761Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bd353d07-ea80-4f6f-95a9-124057a1d35a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:47.960Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=564b45d6-79b0-4466-8b22-bdcf8366262d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=517 EndTimestamp=2021-07-13T00:02:47.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:47.443Z InvocationID=4930bb47-5b38-4467-9951-6b4f8abea4da ResponseDesc=OK 2021-07-13T00:02:47.961Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bd353d07-ea80-4f6f-95a9-124057a1d35a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=295 EndTimestamp=2021-07-13T00:02:47.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:47.666Z InvocationID=51b3101e-482a-4b81-9f22-d1a889e31c21 ResponseDesc=OK 2021-07-13T00:02:48.875Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8c7e413f-f256-4c0b-8153-3acf43d63a98 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:48.874Z InvocationID=df5ac62e-e2eb-43e9-bfcc-c80f5f2fed4d 2021-07-13T00:02:49.211Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8c7e413f-f256-4c0b-8153-3acf43d63a98 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:49.622Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8c7e413f-f256-4c0b-8153-3acf43d63a98 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=748 EndTimestamp=2021-07-13T00:02:49.622Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:48.874Z InvocationID=f1626b8c-18c6-4b45-ae6b-4a20407af5c4 ResponseDesc=OK 2021-07-13T00:02:50.968Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=61f69a6f-d1e2-48b3-8e4f-e550a21fdea3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:50.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:50.968Z InvocationID=4925e419-a2ef-4559-9d49-1a0581ffd880 2021-07-13T00:02:51.157Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=61f69a6f-d1e2-48b3-8e4f-e550a21fdea3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:51.460Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=61f69a6f-d1e2-48b3-8e4f-e550a21fdea3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=492 EndTimestamp=2021-07-13T00:02:51.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:50.968Z InvocationID=fbbddea7-c68c-488f-b7a2-5ed33b6b7c6c ResponseDesc=OK 2021-07-13T00:02:54.062Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=18ca92b8-2848-4c47-a2a9-2fd6cd0c6433 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:54.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:54.062Z InvocationID=3a1e52fb-a2bf-46ff-b5e7-61dad937a3ef 2021-07-13T00:02:54.160Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=18ca92b8-2848-4c47-a2a9-2fd6cd0c6433 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:54.357Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=18ca92b8-2848-4c47-a2a9-2fd6cd0c6433 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=295 EndTimestamp=2021-07-13T00:02:54.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:54.062Z InvocationID=b9d344fb-aa79-47da-a824-f0ea19177fb2 ResponseDesc=OK 2021-07-13T00:02:57.359Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d4122d9-26b2-4d35-9433-09ac0d1865e2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:57.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:57.359Z InvocationID=c4a6d4d9-5085-4650-9d92-bb5b47017dfd 2021-07-13T00:02:57.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=36691b3f-7065-47a6-b770-3724e78cd338 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:57.439Z InvocationID=e95ff657-f5ac-4855-a767-0b4ed1752059 2021-07-13T00:02:57.559Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=36691b3f-7065-47a6-b770-3724e78cd338 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:58.418Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d4122d9-26b2-4d35-9433-09ac0d1865e2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:58.618Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=36691b3f-7065-47a6-b770-3724e78cd338 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1179 EndTimestamp=2021-07-13T00:02:58.618Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:57.439Z InvocationID=7834a87b-4570-4480-a016-bc30b1ce20e4 ResponseDesc=OK 2021-07-13T00:02:58.759Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d4122d9-26b2-4d35-9433-09ac0d1865e2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1400 EndTimestamp=2021-07-13T00:02:58.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:57.359Z InvocationID=6979a5f6-9988-4616-ae63-374c12a9fb45 ResponseDesc=OK 2021-07-13T00:02:58.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b0011619-f9a4-4e5a-95d8-e0f54ee191c8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:02:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:58.873Z InvocationID=d439bf25-26f2-4650-8b37-57ae6a732179 2021-07-13T00:02:59.059Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b0011619-f9a4-4e5a-95d8-e0f54ee191c8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:02:59.258Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b0011619-f9a4-4e5a-95d8-e0f54ee191c8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=385 EndTimestamp=2021-07-13T00:02:59.258Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:02:58.873Z InvocationID=373a9868-5ac4-42de-bc90-7d8500187040 ResponseDesc=OK 2021-07-13T00:03:00.071Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ba21c2f4-d51c-453e-abf7-cc12f3a50018 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:00.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:00.071Z InvocationID=dfadfdfa-17eb-4a26-b016-eeb442a2a551 2021-07-13T00:03:00.312Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ba21c2f4-d51c-453e-abf7-cc12f3a50018 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:00.813Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ba21c2f4-d51c-453e-abf7-cc12f3a50018 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=742 EndTimestamp=2021-07-13T00:03:00.813Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:00.071Z InvocationID=3a62cf2e-2c6b-48ec-9154-768bd5e0b4c1 ResponseDesc=OK 2021-07-13T00:03:03.070Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=82c5d89a-60ce-4f82-9d48-1e0e4ec11293 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:03.070Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:03.070Z InvocationID=57e9bd69-59f7-413d-a545-85cca0f71364 2021-07-13T00:03:03.257Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=82c5d89a-60ce-4f82-9d48-1e0e4ec11293 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:03.859Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=82c5d89a-60ce-4f82-9d48-1e0e4ec11293 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=789 EndTimestamp=2021-07-13T00:03:03.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:03.070Z InvocationID=ad672ec3-4814-40f3-aacc-38d80ec42aab ResponseDesc=OK 2021-07-13T00:03:05.668Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=94c7f4e1-3f48-4eed-a9a8-badd35ecad97 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:05.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:05.668Z InvocationID=54dcef79-1077-4888-8ebb-5405c995fa15 2021-07-13T00:03:05.760Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=94c7f4e1-3f48-4eed-a9a8-badd35ecad97 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:05.858Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=94c7f4e1-3f48-4eed-a9a8-badd35ecad97 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=190 EndTimestamp=2021-07-13T00:03:05.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:05.668Z InvocationID=e2b5fbc1-f522-4286-853d-617b410df476 ResponseDesc=OK 2021-07-13T00:03:07.440Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e9b9aeb2-f806-4786-8da5-52d79d49c3df InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:07.439Z InvocationID=4800d096-c981-4d0e-bfad-ae893c6e35ac 2021-07-13T00:03:07.463Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e9b9aeb2-f806-4786-8da5-52d79d49c3df InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:07.569Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e9b9aeb2-f806-4786-8da5-52d79d49c3df InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=130 EndTimestamp=2021-07-13T00:03:07.569Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:07.439Z InvocationID=5224c737-7477-476d-b762-e19e2e09fe53 ResponseDesc=OK 2021-07-13T00:03:08.874Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3864adc5-f194-4606-9d6d-64ca514af894 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:08.874Z InvocationID=d0b87f45-d556-4df4-a33f-439aadd8cc9e 2021-07-13T00:03:09.157Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3864adc5-f194-4606-9d6d-64ca514af894 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:09.175Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f3eddab9-e581-4c7b-abe0-a66d791b3c29 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:09.175Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:09.175Z InvocationID=ddd56804-fd08-4c1e-88e3-c64f035a67ff 2021-07-13T00:03:09.361Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f3eddab9-e581-4c7b-abe0-a66d791b3c29 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:09.557Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f3eddab9-e581-4c7b-abe0-a66d791b3c29 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=382 EndTimestamp=2021-07-13T00:03:09.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:09.175Z InvocationID=585785f3-cc11-4669-93c1-3b8a699d457a ResponseDesc=OK 2021-07-13T00:03:09.560Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3864adc5-f194-4606-9d6d-64ca514af894 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=685 EndTimestamp=2021-07-13T00:03:09.559Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:08.874Z InvocationID=e17a4060-2b63-4be3-8c80-abf6eeebc5bd ResponseDesc=OK 2021-07-13T00:03:11.782Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d9653cc5-a9fe-4f67-a3ec-02b7c4665071 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:11.781Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:11.781Z InvocationID=e014aafc-f7ec-44a3-a248-24b539cfdaeb 2021-07-13T00:03:12.012Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d9653cc5-a9fe-4f67-a3ec-02b7c4665071 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:12.314Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d9653cc5-a9fe-4f67-a3ec-02b7c4665071 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=533 EndTimestamp=2021-07-13T00:03:12.314Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:11.781Z InvocationID=8295b391-e9ac-40e9-855b-0b6ea93fa90c ResponseDesc=OK 2021-07-13T00:03:15.362Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0d4da68f-75ad-41e8-a901-6c9940c0e7ee InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:15.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:15.361Z InvocationID=619296b8-fb28-4f4c-bbce-8794fd2a92f8 2021-07-13T00:03:15.557Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0d4da68f-75ad-41e8-a901-6c9940c0e7ee InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:15.960Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0d4da68f-75ad-41e8-a901-6c9940c0e7ee InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=599 EndTimestamp=2021-07-13T00:03:15.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:15.361Z InvocationID=7b65a59d-ca2d-4f5b-ac2e-9afd6b2f1418 ResponseDesc=OK 2021-07-13T00:03:17.441Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=242017df-8a32-4d2f-8be7-e3cc987f008c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:17.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:17.441Z InvocationID=f108a7e8-7c40-4ae8-8314-c089715885a8 2021-07-13T00:03:17.559Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=242017df-8a32-4d2f-8be7-e3cc987f008c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:17.758Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=242017df-8a32-4d2f-8be7-e3cc987f008c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=317 EndTimestamp=2021-07-13T00:03:17.758Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:17.441Z InvocationID=3b8a5d09-2904-46a1-8ff8-0849dda70016 ResponseDesc=OK 2021-07-13T00:03:18.170Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f857384c-1c13-419f-b879-e00cdff9fddd InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:18.170Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:18.170Z InvocationID=15d677a3-0ce2-4cee-aa51-a0a43754e2df 2021-07-13T00:03:18.263Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f857384c-1c13-419f-b879-e00cdff9fddd InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:18.512Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f857384c-1c13-419f-b879-e00cdff9fddd InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=342 EndTimestamp=2021-07-13T00:03:18.512Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:18.170Z InvocationID=98ba434c-d582-4bb0-b647-4c974a8e8a7e ResponseDesc=OK 2021-07-13T00:03:18.873Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7f07f069-e8b3-46dc-868a-f8b7d720c193 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:18.873Z InvocationID=e1a599cd-9e43-41b4-a0d3-fee1aaf050e3 2021-07-13T00:03:19.057Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7f07f069-e8b3-46dc-868a-f8b7d720c193 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:19.460Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7f07f069-e8b3-46dc-868a-f8b7d720c193 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=586 EndTimestamp=2021-07-13T00:03:19.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:18.873Z InvocationID=f7fa1769-ab44-466b-9c0d-e49b9412b258 ResponseDesc=OK 2021-07-13T00:03:20.671Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fc7854d4-bff2-45b8-9d22-e83e1f044254 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:20.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:20.671Z InvocationID=1910d6b5-1388-4508-bef7-656eb33b1a9e 2021-07-13T00:03:20.859Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fc7854d4-bff2-45b8-9d22-e83e1f044254 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:21.057Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fc7854d4-bff2-45b8-9d22-e83e1f044254 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=386 EndTimestamp=2021-07-13T00:03:21.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:20.671Z InvocationID=6166ac5f-82c2-4005-be5a-4462bf7338b1 ResponseDesc=OK 2021-07-13T00:03:23.672Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e650ce89-0a4d-48dc-9298-1aa396b03e8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:23.672Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:23.672Z InvocationID=4af6a3b8-0ce5-4abf-90ee-60f4642619c9 2021-07-13T00:03:23.913Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e650ce89-0a4d-48dc-9298-1aa396b03e8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:24.312Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e650ce89-0a4d-48dc-9298-1aa396b03e8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=640 EndTimestamp=2021-07-13T00:03:24.312Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:23.672Z InvocationID=0c27a0f8-c07b-448f-9f9c-57bd7789c29a ResponseDesc=OK 2021-07-13T00:03:27.166Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aa049e0e-ed56-4105-9ade-fcf54d6921a8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:27.166Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:27.166Z InvocationID=c7414f94-1ce8-47ac-aa7e-6ec86a43d811 2021-07-13T00:03:27.439Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=30a5a21e-ba3d-473d-99c9-361fbd35de78 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:27.439Z InvocationID=6d3097c9-08fa-4773-83a4-ebb9a76139b5 2021-07-13T00:03:27.556Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aa049e0e-ed56-4105-9ade-fcf54d6921a8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:27.712Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=30a5a21e-ba3d-473d-99c9-361fbd35de78 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:27.760Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aa049e0e-ed56-4105-9ade-fcf54d6921a8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=594 EndTimestamp=2021-07-13T00:03:27.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:27.166Z InvocationID=6276c96f-be33-460b-a5d6-85de57ef96f4 ResponseDesc=OK 2021-07-13T00:03:28.162Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=30a5a21e-ba3d-473d-99c9-361fbd35de78 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=723 EndTimestamp=2021-07-13T00:03:28.162Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:27.439Z InvocationID=5db7acd2-aeb2-41f6-ba41-75f5e7081995 ResponseDesc=OK 2021-07-13T00:03:28.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1f384c57-bc35-4d5b-83d7-c6b0e8ca2f62 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:28.873Z InvocationID=0fc65346-aaa4-4328-bdb0-86b8ea723838 2021-07-13T00:03:29.115Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1f384c57-bc35-4d5b-83d7-c6b0e8ca2f62 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:29.513Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1f384c57-bc35-4d5b-83d7-c6b0e8ca2f62 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=640 EndTimestamp=2021-07-13T00:03:29.513Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:28.873Z InvocationID=36d06d3c-6226-45fe-add1-d5ff02aa62d8 ResponseDesc=OK 2021-07-13T00:03:30.267Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=95bb55f6-a11d-4008-aafd-a91ca995f667 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:30.266Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:30.266Z InvocationID=9fd318ca-dc39-4760-ae66-1b2c80e72235 2021-07-13T00:03:30.457Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=95bb55f6-a11d-4008-aafd-a91ca995f667 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:30.870Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=95bb55f6-a11d-4008-aafd-a91ca995f667 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=604 EndTimestamp=2021-07-13T00:03:30.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:30.266Z InvocationID=46b64b58-b5b3-4666-b934-fc0d1ef61581 ResponseDesc=OK 2021-07-13T00:03:33.274Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=46aa3526-6716-4a9e-aca2-7a058acfccc9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:33.274Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:33.274Z InvocationID=88606729-8f2e-4ea6-909e-8d8d935ea498 2021-07-13T00:03:33.459Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=46aa3526-6716-4a9e-aca2-7a058acfccc9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:33.657Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=46aa3526-6716-4a9e-aca2-7a058acfccc9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=383 EndTimestamp=2021-07-13T00:03:33.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:33.274Z InvocationID=5b3eca56-8be1-440f-b0e0-6f869df7fef9 ResponseDesc=OK 2021-07-13T00:03:35.669Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=21c23ae0-b036-4d21-a082-d6aaf44ce7ce InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:35.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:35.669Z InvocationID=4243463c-5f78-4010-a397-3f39e79a11c0 2021-07-13T00:03:35.915Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=21c23ae0-b036-4d21-a082-d6aaf44ce7ce InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:36.312Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=21c23ae0-b036-4d21-a082-d6aaf44ce7ce InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=643 EndTimestamp=2021-07-13T00:03:36.312Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:35.669Z InvocationID=d31ae57d-b4eb-4d24-885d-7759deca0a17 ResponseDesc=OK 2021-07-13T00:03:37.439Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=27a0f16c-8e47-47d7-92f0-704972ab14a1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:37.439Z InvocationID=50673cfd-411a-44dc-bf05-f9088d213d70 2021-07-13T00:03:37.556Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=27a0f16c-8e47-47d7-92f0-704972ab14a1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:38.059Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=27a0f16c-8e47-47d7-92f0-704972ab14a1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=620 EndTimestamp=2021-07-13T00:03:38.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:37.439Z InvocationID=a357f0ad-956c-466c-9094-f66f751d1d3e ResponseDesc=OK 2021-07-13T00:03:38.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=788b52d7-4c80-451f-8b9e-971d3c3a80ba InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:38.873Z InvocationID=6fb1ab0f-7b2c-4b11-8d3e-8e10da81b579 2021-07-13T00:03:39.058Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=788b52d7-4c80-451f-8b9e-971d3c3a80ba InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:39.160Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d531524a-09dd-46ff-89a6-f52d0152162a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:39.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:39.160Z InvocationID=b0e22999-e07c-42c9-a593-3fbcfa954595 2021-07-13T00:03:39.260Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d531524a-09dd-46ff-89a6-f52d0152162a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:39.264Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=788b52d7-4c80-451f-8b9e-971d3c3a80ba InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=391 EndTimestamp=2021-07-13T00:03:39.264Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:38.873Z InvocationID=454f89f1-7921-48cc-b50f-e4544d2e8890 ResponseDesc=OK 2021-07-13T00:03:39.360Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d531524a-09dd-46ff-89a6-f52d0152162a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=200 EndTimestamp=2021-07-13T00:03:39.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:39.160Z InvocationID=10eb6a73-90b3-4576-9a93-51d2b39449c4 ResponseDesc=OK 2021-07-13T00:03:41.865Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=abeb3a70-3967-4ab0-a91f-e145ccbb9a0a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:41.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:41.865Z InvocationID=f6feaf3a-130f-4800-af40-51b051246578 2021-07-13T00:03:42.056Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=abeb3a70-3967-4ab0-a91f-e145ccbb9a0a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:42.460Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=abeb3a70-3967-4ab0-a91f-e145ccbb9a0a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=594 EndTimestamp=2021-07-13T00:03:42.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:41.865Z InvocationID=0344c495-061b-403b-aa28-24e4f99aa61c ResponseDesc=OK 2021-07-13T00:03:44.963Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e3d5b5ab-f471-4469-b7f5-c2f8da95c418 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:44.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:44.962Z InvocationID=9efa8032-daf9-46f4-9021-a86fbb9ecdc1 2021-07-13T00:03:45.059Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e3d5b5ab-f471-4469-b7f5-c2f8da95c418 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:45.357Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e3d5b5ab-f471-4469-b7f5-c2f8da95c418 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=395 EndTimestamp=2021-07-13T00:03:45.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:44.962Z InvocationID=574797a8-3814-4b08-8773-51d50f6da6a0 ResponseDesc=OK 2021-07-13T00:03:47.442Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=75a5d421-4009-4f8a-a68d-5e7c950001e3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:47.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:47.442Z InvocationID=2001c9ff-7d8b-4620-901f-7bd02c2acb66 2021-07-13T00:03:47.711Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=75a5d421-4009-4f8a-a68d-5e7c950001e3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:48.064Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8bc156c0-836b-4c2e-be96-d884f8593422 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:48.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:48.064Z InvocationID=6e0886d6-72fd-484e-bbdc-c8d175eae0d8 2021-07-13T00:03:48.112Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=75a5d421-4009-4f8a-a68d-5e7c950001e3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=670 EndTimestamp=2021-07-13T00:03:48.112Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:47.442Z InvocationID=9f9fcf1c-671a-421f-9b75-383086767b47 ResponseDesc=OK 2021-07-13T00:03:48.256Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8bc156c0-836b-4c2e-be96-d884f8593422 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:48.567Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8bc156c0-836b-4c2e-be96-d884f8593422 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=503 EndTimestamp=2021-07-13T00:03:48.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:48.064Z InvocationID=230b71d0-9f89-43ef-9a8c-0338019daa1e ResponseDesc=OK 2021-07-13T00:03:48.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7e7e2cf0-2b6f-4a82-8026-75ee06cb06b5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:48.874Z InvocationID=9a87c2c2-f65e-49eb-9eb0-16911b51ccf4 2021-07-13T00:03:48.960Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7e7e2cf0-2b6f-4a82-8026-75ee06cb06b5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:49.157Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7e7e2cf0-2b6f-4a82-8026-75ee06cb06b5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=283 EndTimestamp=2021-07-13T00:03:49.157Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:48.874Z InvocationID=dcf23067-163e-428c-b97a-5a94f14b1bac ResponseDesc=OK 2021-07-13T00:03:51.061Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=302cca5b-d0be-48ff-bce0-3ce35fb4bf61 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:51.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:51.061Z InvocationID=1d2a6ea8-0f6b-4877-8389-4abf4a0c7bf5 2021-07-13T00:03:51.311Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=302cca5b-d0be-48ff-bce0-3ce35fb4bf61 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:51.714Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=302cca5b-d0be-48ff-bce0-3ce35fb4bf61 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=652 EndTimestamp=2021-07-13T00:03:51.713Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:51.061Z InvocationID=4ec27fca-a2b6-456d-8977-fa4d6da61cb0 ResponseDesc=OK 2021-07-13T00:03:54.064Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5899d0b2-f778-4ce7-8293-32a49279aed4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:54.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:54.064Z InvocationID=75221eff-c42d-460a-800e-d6208ff48c95 2021-07-13T00:03:54.256Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5899d0b2-f778-4ce7-8293-32a49279aed4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:54.659Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5899d0b2-f778-4ce7-8293-32a49279aed4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=595 EndTimestamp=2021-07-13T00:03:54.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:54.064Z InvocationID=8b1125f1-6cf3-401b-b2ab-8820f3a0b9ad ResponseDesc=OK 2021-07-13T00:03:56.965Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a001256b-c446-4a31-a9e1-43b955c9b547 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:56.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:56.965Z InvocationID=d7d03564-6a41-4d28-86c3-d1316813a7b8 2021-07-13T00:03:57.060Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a001256b-c446-4a31-a9e1-43b955c9b547 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:57.257Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a001256b-c446-4a31-a9e1-43b955c9b547 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=292 EndTimestamp=2021-07-13T00:03:57.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:56.965Z InvocationID=f32eebc1-89d4-4a69-b4ed-2d560b900148 ResponseDesc=OK 2021-07-13T00:03:57.440Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fc48374b-ee72-475a-8a2a-d152941899b1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:57.440Z InvocationID=13127d6b-f15d-4d58-bb58-e9b86094eeae 2021-07-13T00:03:57.711Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fc48374b-ee72-475a-8a2a-d152941899b1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:58.059Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fc48374b-ee72-475a-8a2a-d152941899b1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=619 EndTimestamp=2021-07-13T00:03:58.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:57.440Z InvocationID=473580ba-34b5-4e1e-82e1-9625c381d33a ResponseDesc=OK 2021-07-13T00:03:58.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ee8530f1-fe8b-4984-af7f-e6d10078f52f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:03:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:58.873Z InvocationID=e7b23f91-1702-457f-915d-6a2f5527c78d 2021-07-13T00:03:59.157Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ee8530f1-fe8b-4984-af7f-e6d10078f52f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:03:59.661Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ee8530f1-fe8b-4984-af7f-e6d10078f52f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=788 EndTimestamp=2021-07-13T00:03:59.661Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:03:58.873Z InvocationID=987b957d-17fb-48a3-a4d9-61d5d60de220 ResponseDesc=OK 2021-07-13T00:04:00.063Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=43db8098-7f8c-438c-9c22-98658006d115 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:00.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:00.062Z InvocationID=7a809bf6-3e9f-4ba9-bb38-f2e5f1122aab 2021-07-13T00:04:00.259Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=43db8098-7f8c-438c-9c22-98658006d115 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:00.457Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=43db8098-7f8c-438c-9c22-98658006d115 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=395 EndTimestamp=2021-07-13T00:04:00.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:00.062Z InvocationID=ce589564-d5e5-4541-8e83-f0b7b06e702c ResponseDesc=OK 2021-07-13T00:04:03.171Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31a1fb10-13b8-4523-a227-dd0103d71cfd InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:03.171Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:03.171Z InvocationID=7fa3709d-8135-43da-8f28-a247699bd8f1 2021-07-13T00:04:03.412Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31a1fb10-13b8-4523-a227-dd0103d71cfd InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:03.811Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31a1fb10-13b8-4523-a227-dd0103d71cfd InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=640 EndTimestamp=2021-07-13T00:04:03.811Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:03.171Z InvocationID=d9b19beb-9b41-41c3-8712-2538c7acba44 ResponseDesc=OK 2021-07-13T00:04:06.063Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=294a39df-aa18-40d9-91eb-9dfe7cf5b5e9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:06.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:06.063Z InvocationID=01fba465-34cd-4487-9a7d-c404ca410778 2021-07-13T00:04:06.257Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=294a39df-aa18-40d9-91eb-9dfe7cf5b5e9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:07.440Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=75a75bce-92c3-47c9-a958-ca12a39cbdba InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:07.440Z InvocationID=23937866-5bfd-4d8b-bfa7-93ee7c864073 2021-07-13T00:04:07.560Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=75a75bce-92c3-47c9-a958-ca12a39cbdba InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:08.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bc3ddd4a-0c3e-4afd-8f0c-8a53f82500cf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:08.873Z InvocationID=7c1d08fa-a2c6-44ba-b934-7f6418440ba5 2021-07-13T00:04:08.960Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=75a75bce-92c3-47c9-a958-ca12a39cbdba InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1520 EndTimestamp=2021-07-13T00:04:08.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:07.440Z InvocationID=4f75e931-36de-4cdd-9e3e-1b6dafe1fd69 ResponseDesc=OK 2021-07-13T00:04:09.060Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=294a39df-aa18-40d9-91eb-9dfe7cf5b5e9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=2997 EndTimestamp=2021-07-13T00:04:09.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:06.063Z InvocationID=aae7846a-8218-45b6-bb6c-43c2144fef5e ResponseDesc=OK 2021-07-13T00:04:09.111Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bc3ddd4a-0c3e-4afd-8f0c-8a53f82500cf InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:09.513Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bc3ddd4a-0c3e-4afd-8f0c-8a53f82500cf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=640 EndTimestamp=2021-07-13T00:04:09.513Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:08.873Z InvocationID=6326cfe9-4217-4e47-b15b-196feafd54d0 ResponseDesc=OK 2021-07-13T00:04:10.077Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d91467d6-7bca-4024-b08b-f3fd30a74861 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:10.076Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:10.076Z InvocationID=63079bf5-72c4-47a8-9466-529b386c32f7 2021-07-13T00:04:10.268Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d91467d6-7bca-4024-b08b-f3fd30a74861 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:10.571Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d91467d6-7bca-4024-b08b-f3fd30a74861 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=495 EndTimestamp=2021-07-13T00:04:10.571Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:10.076Z InvocationID=cb7449fc-e107-4247-b97d-4b63322e8ce3 ResponseDesc=OK 2021-07-13T00:04:11.870Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=040c2319-10f6-49ba-bce0-46f9cfb3e1c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:11.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:11.870Z InvocationID=1be20927-6273-430e-8de7-1d60bf14769d 2021-07-13T00:04:11.960Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=040c2319-10f6-49ba-bce0-46f9cfb3e1c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:12.158Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=040c2319-10f6-49ba-bce0-46f9cfb3e1c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=288 EndTimestamp=2021-07-13T00:04:12.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:11.870Z InvocationID=f3c34651-687d-4a78-8548-337e41a21354 ResponseDesc=OK 2021-07-13T00:04:14.961Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=24655201-9c43-48de-bf61-02a60be223ff InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:14.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:14.961Z InvocationID=32a89836-ff80-4226-88ee-075218fe2e2e 2021-07-13T00:04:15.218Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=24655201-9c43-48de-bf61-02a60be223ff InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:16.613Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=24655201-9c43-48de-bf61-02a60be223ff InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1652 EndTimestamp=2021-07-13T00:04:16.613Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:14.961Z InvocationID=018f7cd9-d3c5-4e01-b203-35f7187d5ae0 ResponseDesc=OK 2021-07-13T00:04:17.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fda19497-cfc7-4ec5-ac86-41ba34740172 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:17.439Z InvocationID=8799122b-f5ae-43e3-a3ac-7930152d1763 2021-07-13T00:04:17.557Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fda19497-cfc7-4ec5-ac86-41ba34740172 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:18.266Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fda19497-cfc7-4ec5-ac86-41ba34740172 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=827 EndTimestamp=2021-07-13T00:04:18.266Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:17.439Z InvocationID=fbce34e0-0d65-4149-ae1f-0891d7bd5426 ResponseDesc=OK 2021-07-13T00:04:18.377Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=afaeab0b-7b2b-4080-9c47-ca84dcac9d32 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:18.377Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:18.377Z InvocationID=3081037e-df1d-4cf6-917c-ad59c9024099 2021-07-13T00:04:18.561Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=afaeab0b-7b2b-4080-9c47-ca84dcac9d32 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:18.757Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=afaeab0b-7b2b-4080-9c47-ca84dcac9d32 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=380 EndTimestamp=2021-07-13T00:04:18.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:18.377Z InvocationID=64ef1438-9073-45b7-b9a7-619d28332686 ResponseDesc=OK 2021-07-13T00:04:18.873Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ba412e78-b272-4550-8a07-11fa63863a0d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:18.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:18.872Z InvocationID=9a3e09c7-fd38-4878-adc0-4b0b5086e43f 2021-07-13T00:04:19.115Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ba412e78-b272-4550-8a07-11fa63863a0d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:19.512Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ba412e78-b272-4550-8a07-11fa63863a0d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=640 EndTimestamp=2021-07-13T00:04:19.512Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:18.872Z InvocationID=6ea3b282-1be8-4d2e-84f6-58938925fb4e ResponseDesc=OK 2021-07-13T00:04:21.065Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e02e247-d3b0-4c7d-9759-8154f25c6c78 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:21.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:21.065Z InvocationID=3238b894-cbea-48ef-b4e9-713216fd87da 2021-07-13T00:04:21.356Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e02e247-d3b0-4c7d-9759-8154f25c6c78 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:21.660Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e02e247-d3b0-4c7d-9759-8154f25c6c78 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=595 EndTimestamp=2021-07-13T00:04:21.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:21.065Z InvocationID=f7175b53-dfe4-4ecc-b30f-0ddaac426804 ResponseDesc=OK 2021-07-13T00:04:23.866Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6a9a3bd6-fed6-47cf-8685-8bd8c292fbdf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:23.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:23.866Z InvocationID=4a92ddee-826f-4138-9cbb-b0d1c2a82865 2021-07-13T00:04:23.959Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6a9a3bd6-fed6-47cf-8685-8bd8c292fbdf InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:24.657Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6a9a3bd6-fed6-47cf-8685-8bd8c292fbdf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=791 EndTimestamp=2021-07-13T00:04:24.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:23.866Z InvocationID=c884a577-a6d9-4a5a-9647-03466e6a01cd ResponseDesc=OK 2021-07-13T00:04:26.961Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=262f969b-e615-46f9-a139-a7964881ad4d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:26.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:26.961Z InvocationID=017370ce-0568-4f89-836d-a102efd9938d 2021-07-13T00:04:27.212Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=262f969b-e615-46f9-a139-a7964881ad4d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:27.439Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e6123ac-e802-4c80-8c2d-ad86f2bf8c84 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:27.439Z InvocationID=2413118c-f750-406d-8608-6ddc57dc3386 2021-07-13T00:04:27.615Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=262f969b-e615-46f9-a139-a7964881ad4d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=654 EndTimestamp=2021-07-13T00:04:27.615Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:26.961Z InvocationID=21b74fb8-95db-4863-bba6-afa1c4d46414 ResponseDesc=OK 2021-07-13T00:04:27.657Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e6123ac-e802-4c80-8c2d-ad86f2bf8c84 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:28.060Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e6123ac-e802-4c80-8c2d-ad86f2bf8c84 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=621 EndTimestamp=2021-07-13T00:04:28.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:27.439Z InvocationID=ca13ccd8-fac0-4e6f-8c69-ec821b2562c1 ResponseDesc=OK 2021-07-13T00:04:28.872Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d3f14b63-8dd3-4a48-a82a-792ca6b2b475 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:28.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:28.872Z InvocationID=1d74805d-3703-42f1-add9-831f64a579d8 2021-07-13T00:04:28.959Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d3f14b63-8dd3-4a48-a82a-792ca6b2b475 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:29.157Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d3f14b63-8dd3-4a48-a82a-792ca6b2b475 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=285 EndTimestamp=2021-07-13T00:04:29.157Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:28.872Z InvocationID=ba04c083-ac54-4a11-b919-bb2c26f2cde8 ResponseDesc=OK 2021-07-13T00:04:29.966Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9683e96-7054-479d-bd9c-cbabd7df8c92 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:29.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:29.966Z InvocationID=28e8457a-68cd-41ee-ada8-20cc8fe74c4b 2021-07-13T00:04:30.111Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b9683e96-7054-479d-bd9c-cbabd7df8c92 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:30.712Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b9683e96-7054-479d-bd9c-cbabd7df8c92 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=746 EndTimestamp=2021-07-13T00:04:30.712Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:29.966Z InvocationID=fe29ddc2-95c4-4f27-a22c-dd14ccd7cccd ResponseDesc=OK 2021-07-13T00:04:32.961Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f1c5b41b-38f7-458b-9d69-c4d582a4b95c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:32.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:32.961Z InvocationID=9d97127b-e994-41fc-b95d-2e86280a0ceb 2021-07-13T00:04:33.060Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f1c5b41b-38f7-458b-9d69-c4d582a4b95c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:33.460Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f1c5b41b-38f7-458b-9d69-c4d582a4b95c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=499 EndTimestamp=2021-07-13T00:04:33.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:32.961Z InvocationID=ffb68d17-b5d1-48e1-b37c-67b7be6cd80b ResponseDesc=OK 2021-07-13T00:04:35.875Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1d25c43f-a8d5-4482-94d9-df68516e10fa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:35.875Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:35.875Z InvocationID=d87fd681-12db-4280-8932-cc12f3f1612c 2021-07-13T00:04:36.959Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1d25c43f-a8d5-4482-94d9-df68516e10fa InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:37.158Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1d25c43f-a8d5-4482-94d9-df68516e10fa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1283 EndTimestamp=2021-07-13T00:04:37.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:35.875Z InvocationID=9e18c2ed-25d4-4913-9a2d-83ab77089f7d ResponseDesc=OK 2021-07-13T00:04:37.441Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7a593f57-1b89-452d-a921-7ed683a467d6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:37.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:37.441Z InvocationID=b57316c0-5af4-4a5d-a63a-0040f089de1f 2021-07-13T00:04:37.711Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7a593f57-1b89-452d-a921-7ed683a467d6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:38.112Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7a593f57-1b89-452d-a921-7ed683a467d6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=671 EndTimestamp=2021-07-13T00:04:38.112Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:37.441Z InvocationID=c9e8b0ef-230d-4fca-9f7a-a5fa5e5ae988 ResponseDesc=OK 2021-07-13T00:04:38.770Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7334676a-b30b-45e6-bab1-4073e630e0ff InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:38.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:38.769Z InvocationID=7b7354c9-f3b6-46ce-939f-d3aa1c384ce9 2021-07-13T00:04:38.873Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5a503de3-c216-4876-af61-771cc1e048a0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:38.873Z InvocationID=7e06e082-b3e9-4e5a-bd68-8a0c52f0520e 2021-07-13T00:04:38.957Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7334676a-b30b-45e6-bab1-4073e630e0ff InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:39.120Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5a503de3-c216-4876-af61-771cc1e048a0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:39.160Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7334676a-b30b-45e6-bab1-4073e630e0ff InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=391 EndTimestamp=2021-07-13T00:04:39.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:38.769Z InvocationID=1f17d5e7-0631-4b10-ae6b-64bcee95cba9 ResponseDesc=OK 2021-07-13T00:04:39.358Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5a503de3-c216-4876-af61-771cc1e048a0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=485 EndTimestamp=2021-07-13T00:04:39.358Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:38.873Z InvocationID=e36b5e63-e030-460c-a6ba-41903177ca95 ResponseDesc=OK 2021-07-13T00:04:42.162Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c01ef30e-43f5-4925-9c77-a2ec9a27b846 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:42.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:42.162Z InvocationID=35a1dbe7-3f15-43d7-82e8-db0d81f08d5d 2021-07-13T00:04:42.412Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c01ef30e-43f5-4925-9c77-a2ec9a27b846 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:42.818Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c01ef30e-43f5-4925-9c77-a2ec9a27b846 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=656 EndTimestamp=2021-07-13T00:04:42.818Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:42.162Z InvocationID=79daa99f-2139-4e73-9e82-e5d48725d9d3 ResponseDesc=OK 2021-07-13T00:04:44.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2c4452b8-341e-47a4-a817-f45770fb00cb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:44.874Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:44.874Z InvocationID=2fbdaaf4-6501-4713-891a-1b823a34fbd0 2021-07-13T00:04:45.156Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2c4452b8-341e-47a4-a817-f45770fb00cb InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:45.463Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2c4452b8-341e-47a4-a817-f45770fb00cb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=589 EndTimestamp=2021-07-13T00:04:45.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:44.874Z InvocationID=e9d6bfc1-24df-4109-ba64-6811a874abcc ResponseDesc=OK 2021-07-13T00:04:47.439Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=237db55e-76c6-4691-944e-71ae5064053c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:47.439Z InvocationID=ef1940b6-5663-4953-9145-408b0bf7e32a 2021-07-13T00:04:47.559Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=237db55e-76c6-4691-944e-71ae5064053c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:47.760Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=237db55e-76c6-4691-944e-71ae5064053c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=321 EndTimestamp=2021-07-13T00:04:47.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:47.439Z InvocationID=f7ccdc9d-a7c8-4142-964c-31ba223dadee ResponseDesc=OK 2021-07-13T00:04:48.168Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=17b5d1a5-7f21-43c1-8fb0-c69b13ef8c00 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:48.167Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:48.167Z InvocationID=7158d387-6858-465e-8e0a-4fb7bbf404e8 2021-07-13T00:04:48.413Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=17b5d1a5-7f21-43c1-8fb0-c69b13ef8c00 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:48.812Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=17b5d1a5-7f21-43c1-8fb0-c69b13ef8c00 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=645 EndTimestamp=2021-07-13T00:04:48.812Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:48.167Z InvocationID=54007eb5-2bec-4cee-b6b5-00c802f9b897 ResponseDesc=OK 2021-07-13T00:04:48.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9e32db2-34da-4979-aeaf-c961a860815c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:48.873Z InvocationID=d0a3b30b-c3eb-44b5-9ef0-404d778069a8 2021-07-13T00:04:49.057Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b9e32db2-34da-4979-aeaf-c961a860815c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:49.459Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b9e32db2-34da-4979-aeaf-c961a860815c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=586 EndTimestamp=2021-07-13T00:04:49.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:48.873Z InvocationID=5e8e087a-86f8-49c0-bd4c-fdd1f61ef447 ResponseDesc=OK 2021-07-13T00:04:50.861Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2995ba53-191e-4715-9473-3e6e985cf991 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:50.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:50.861Z InvocationID=d6d2c4b9-292f-4f94-b687-4eca4a1ba32c 2021-07-13T00:04:50.959Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2995ba53-191e-4715-9473-3e6e985cf991 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:51.157Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2995ba53-191e-4715-9473-3e6e985cf991 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=296 EndTimestamp=2021-07-13T00:04:51.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:50.861Z InvocationID=61559ed0-c907-426b-ac9a-ed72da9dce34 ResponseDesc=OK 2021-07-13T00:04:54.270Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=822d6ef3-0786-4b46-8aba-201360b91c1e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:54.270Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:54.270Z InvocationID=6f0498d3-a1c6-43cd-b25f-d25a809dfbeb 2021-07-13T00:04:54.814Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=822d6ef3-0786-4b46-8aba-201360b91c1e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:55.216Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=822d6ef3-0786-4b46-8aba-201360b91c1e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=945 EndTimestamp=2021-07-13T00:04:55.215Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:54.270Z InvocationID=03c4a428-47c0-4813-a51f-5892dad791c0 ResponseDesc=OK 2021-07-13T00:04:56.872Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7666bec1-41df-46d5-8358-653d2ce35d6a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:56.872Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:56.872Z InvocationID=d1aea4c0-72b8-4c03-920c-e23f65044933 2021-07-13T00:04:57.059Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7666bec1-41df-46d5-8358-653d2ce35d6a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:57.439Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=95743a03-170c-48b5-8493-12bad635248d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:57.439Z InvocationID=7634ea55-864b-4f7f-8203-3d28a637da40 2021-07-13T00:04:57.460Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7666bec1-41df-46d5-8358-653d2ce35d6a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=588 EndTimestamp=2021-07-13T00:04:57.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:56.872Z InvocationID=3c1ce229-5d19-4647-9963-8940e1d19f7e ResponseDesc=OK 2021-07-13T00:04:57.659Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=95743a03-170c-48b5-8493-12bad635248d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:57.857Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=95743a03-170c-48b5-8493-12bad635248d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=418 EndTimestamp=2021-07-13T00:04:57.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:57.439Z InvocationID=a35dccca-6703-4612-bd70-d809ec222253 ResponseDesc=OK 2021-07-13T00:04:58.873Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=80e04734-ae5a-4e66-923c-1057ec700171 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:58.873Z InvocationID=fd9b2008-4987-46e5-9a1b-a8a72388156b 2021-07-13T00:04:58.966Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=80e04734-ae5a-4e66-923c-1057ec700171 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:04:59.067Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=80e04734-ae5a-4e66-923c-1057ec700171 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=194 EndTimestamp=2021-07-13T00:04:59.067Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:58.873Z InvocationID=a8bee6d8-bc49-4337-b42f-d505dbe3c801 ResponseDesc=OK 2021-07-13T00:04:59.879Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4a980148-c2e2-47c0-9106-5c94c2204c61 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:04:59.878Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:59.878Z InvocationID=f9f9c344-313a-42c8-b61a-b1e2972cdb5a 2021-07-13T00:05:00.057Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4a980148-c2e2-47c0-9106-5c94c2204c61 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:00.459Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4a980148-c2e2-47c0-9106-5c94c2204c61 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=581 EndTimestamp=2021-07-13T00:05:00.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:04:59.878Z InvocationID=adc20c8c-31df-4d14-a67e-108dc85a221b ResponseDesc=OK 2021-07-13T00:05:02.764Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c052b642-e441-4c5c-90a5-17c1ac2ff1df InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:02.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:02.764Z InvocationID=5d555a41-91e2-4845-8654-6d45dd84103b 2021-07-13T00:05:02.860Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c052b642-e441-4c5c-90a5-17c1ac2ff1df InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:03.158Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c052b642-e441-4c5c-90a5-17c1ac2ff1df InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=394 EndTimestamp=2021-07-13T00:05:03.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:02.764Z InvocationID=72911f22-ed5d-42af-b32a-c054b58f7d22 ResponseDesc=OK 2021-07-13T00:05:05.875Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=61b060b9-361c-440f-93ef-2cbb3fbccc35 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:05.875Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:05.875Z InvocationID=c5f155fc-7c38-40d7-b659-1e62bb3d629e 2021-07-13T00:05:06.258Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=61b060b9-361c-440f-93ef-2cbb3fbccc35 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:06.612Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=61b060b9-361c-440f-93ef-2cbb3fbccc35 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=737 EndTimestamp=2021-07-13T00:05:06.612Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:05.875Z InvocationID=fcca7781-31da-4803-91e0-cd9f8f505501 ResponseDesc=OK 2021-07-13T00:05:07.439Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9128f6bb-8720-4285-bb82-2e206a6ef255 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:07.439Z InvocationID=fafbf033-8ffb-420e-9ab3-12e92da4bfe0 2021-07-13T00:05:07.557Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9128f6bb-8720-4285-bb82-2e206a6ef255 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:07.960Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9128f6bb-8720-4285-bb82-2e206a6ef255 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=521 EndTimestamp=2021-07-13T00:05:07.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:07.439Z InvocationID=897d880a-020a-403e-93a1-3714ea82676d ResponseDesc=OK 2021-07-13T00:05:08.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1c1fb511-e2b2-4265-b905-5031787c1e13 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:08.874Z InvocationID=373a3b3d-fbd7-4837-a3dc-35d7c5c1cc02 2021-07-13T00:05:08.961Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1c1fb511-e2b2-4265-b905-5031787c1e13 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:09.270Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4d381fbb-39bc-4bbb-97d3-33e9a9095921 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:09.270Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:09.270Z InvocationID=0c0e7e5b-9f7e-4b77-9fe6-393da09d848d 2021-07-13T00:05:09.359Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1c1fb511-e2b2-4265-b905-5031787c1e13 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=485 EndTimestamp=2021-07-13T00:05:09.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:08.874Z InvocationID=092c9a5e-ee69-4306-8394-c4afa8a6655f ResponseDesc=OK 2021-07-13T00:05:09.557Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4d381fbb-39bc-4bbb-97d3-33e9a9095921 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:09.662Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4d381fbb-39bc-4bbb-97d3-33e9a9095921 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=391 EndTimestamp=2021-07-13T00:05:09.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:09.270Z InvocationID=5ddfd30d-31cc-456e-bf41-f42b0f05810f ResponseDesc=OK 2021-07-13T00:05:11.763Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9f2cde3f-df93-4022-a919-15dbe9808607 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:11.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:11.763Z InvocationID=1c6d4677-80a5-4548-80f5-0a61c321f0d6 2021-07-13T00:05:11.860Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9f2cde3f-df93-4022-a919-15dbe9808607 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:12.259Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9f2cde3f-df93-4022-a919-15dbe9808607 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=496 EndTimestamp=2021-07-13T00:05:12.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:11.763Z InvocationID=479d77e0-7471-454d-b706-b933894a959e ResponseDesc=OK 2021-07-13T00:05:14.971Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=27fead88-2872-4082-b379-58d8b9c8bcf0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:14.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:14.971Z InvocationID=5564eaec-8f2f-42df-af07-112c2951b0e2 2021-07-13T00:05:15.160Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=27fead88-2872-4082-b379-58d8b9c8bcf0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:15.360Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=27fead88-2872-4082-b379-58d8b9c8bcf0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=389 EndTimestamp=2021-07-13T00:05:15.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:14.971Z InvocationID=e65ffb96-d5c8-4112-a28f-042db3a522f6 ResponseDesc=OK 2021-07-13T00:05:17.441Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2c532560-3853-4d5c-aaac-7d01ead08b8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:17.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:17.441Z InvocationID=372ece50-7b7f-4aeb-b5f6-8d2070fb17f0 2021-07-13T00:05:17.615Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2c532560-3853-4d5c-aaac-7d01ead08b8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:17.963Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=78f81ef1-f78d-4df9-85fa-d3b31093d78d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:17.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:17.963Z InvocationID=2a50f16a-9bdc-4cbf-b536-3885112bd151 2021-07-13T00:05:18.013Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2c532560-3853-4d5c-aaac-7d01ead08b8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=572 EndTimestamp=2021-07-13T00:05:18.013Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:17.441Z InvocationID=1d5968c9-6903-49b4-b279-06c30bee7e97 ResponseDesc=OK 2021-07-13T00:05:18.156Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=78f81ef1-f78d-4df9-85fa-d3b31093d78d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:18.560Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=78f81ef1-f78d-4df9-85fa-d3b31093d78d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=596 EndTimestamp=2021-07-13T00:05:18.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:17.963Z InvocationID=c3e1b30d-5125-4406-8b35-e205b7f36f76 ResponseDesc=OK 2021-07-13T00:05:18.876Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=750e89d8-3485-48ea-9f31-6afac9b88ccf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:18.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:18.876Z InvocationID=7c1a5a66-9992-4f58-a829-3443a6adc95f 2021-07-13T00:05:19.364Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=750e89d8-3485-48ea-9f31-6afac9b88ccf InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:19.558Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=750e89d8-3485-48ea-9f31-6afac9b88ccf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=682 EndTimestamp=2021-07-13T00:05:19.558Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:18.876Z InvocationID=a6471dfe-be37-45ed-b97c-6fcc704250d4 ResponseDesc=OK 2021-07-13T00:05:21.170Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=293a0822-66b9-4fbb-8ce2-d81d09642589 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:21.170Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:21.170Z InvocationID=52ac09f3-3bce-45a2-80d8-b3c58e02a912 2021-07-13T00:05:21.260Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=293a0822-66b9-4fbb-8ce2-d81d09642589 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:21.811Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=293a0822-66b9-4fbb-8ce2-d81d09642589 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=641 EndTimestamp=2021-07-13T00:05:21.811Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:21.170Z InvocationID=bad708b1-801a-480c-85ad-1b695209a8f2 ResponseDesc=OK 2021-07-13T00:05:23.869Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e654ac45-bdf8-46ed-943a-774935cbccb8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:23.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:23.869Z InvocationID=ac8dfe42-4ac0-48b9-af9a-3d052221568f 2021-07-13T00:05:23.960Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e654ac45-bdf8-46ed-943a-774935cbccb8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:24.623Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e654ac45-bdf8-46ed-943a-774935cbccb8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=754 EndTimestamp=2021-07-13T00:05:24.623Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:23.869Z InvocationID=27d67a4e-7d28-4b2e-8a37-3eac430f7cd1 ResponseDesc=OK 2021-07-13T00:05:26.779Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2bfcfe6e-0724-4ab7-af3d-4b4961961a10 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:26.779Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:26.779Z InvocationID=824f6f05-4438-48f0-934e-90ef3076c1cb 2021-07-13T00:05:26.959Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2bfcfe6e-0724-4ab7-af3d-4b4961961a10 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:27.157Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2bfcfe6e-0724-4ab7-af3d-4b4961961a10 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=378 EndTimestamp=2021-07-13T00:05:27.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:26.779Z InvocationID=4ecb5a03-0a00-4b1d-ab68-deb6e2338a97 ResponseDesc=OK 2021-07-13T00:05:27.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=758e5b1c-1875-49ca-bd80-e4e962f21448 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:27.440Z InvocationID=223ff7ce-f34a-4353-b530-43052bd625e0 2021-07-13T00:05:27.711Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=758e5b1c-1875-49ca-bd80-e4e962f21448 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:28.112Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=758e5b1c-1875-49ca-bd80-e4e962f21448 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=672 EndTimestamp=2021-07-13T00:05:28.112Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:27.440Z InvocationID=21d8e4cd-4d86-41fa-abdb-dccf86a35ebe ResponseDesc=OK 2021-07-13T00:05:28.872Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4156aa14-222e-48f6-86cf-cf56baba5b7b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:28.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:28.872Z InvocationID=37a2de3c-f841-49cb-8087-e0fca9f272b8 2021-07-13T00:05:29.057Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4156aa14-222e-48f6-86cf-cf56baba5b7b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:29.460Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4156aa14-222e-48f6-86cf-cf56baba5b7b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=587 EndTimestamp=2021-07-13T00:05:29.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:28.872Z InvocationID=76e3de9d-e3dc-4f68-ade0-77b34a6a95ba ResponseDesc=OK 2021-07-13T00:05:30.265Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cb57530a-8045-40af-b842-5af478df52aa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:30.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:30.265Z InvocationID=7c5fdee1-31ce-4e4f-a9ea-b6b81bdf5ced 2021-07-13T00:05:30.459Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cb57530a-8045-40af-b842-5af478df52aa InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:30.567Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cb57530a-8045-40af-b842-5af478df52aa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=302 EndTimestamp=2021-07-13T00:05:30.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:30.265Z InvocationID=36908a2c-974d-4e99-9b75-4b6e4bc3bcaa ResponseDesc=OK 2021-07-13T00:05:33.072Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=43af54de-e41a-4bf4-8755-d3620a21a15e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:33.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:33.072Z InvocationID=82535b30-c3e5-40d3-b07f-70bf9f40ab75 2021-07-13T00:05:33.344Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=43af54de-e41a-4bf4-8755-d3620a21a15e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:33.814Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=43af54de-e41a-4bf4-8755-d3620a21a15e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=742 EndTimestamp=2021-07-13T00:05:33.814Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:33.072Z InvocationID=ca7e736d-e690-47a7-86c6-6902b1660d65 ResponseDesc=OK 2021-07-13T00:05:35.767Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=148bcdad-f6e1-4676-b107-e9933c301f86 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:35.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:35.767Z InvocationID=3025d610-1ed2-4b1b-a524-feb9ce3099e5 2021-07-13T00:05:35.860Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=148bcdad-f6e1-4676-b107-e9933c301f86 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:36.259Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=148bcdad-f6e1-4676-b107-e9933c301f86 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=492 EndTimestamp=2021-07-13T00:05:36.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:35.767Z InvocationID=40f51b06-525e-46a2-9570-7df4806d2348 ResponseDesc=OK 2021-07-13T00:05:37.439Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=016087f6-293d-4b9c-a3e3-330e2810f774 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:37.439Z InvocationID=df8b844c-9576-43e2-9b86-04cb1863f7e0 2021-07-13T00:05:37.559Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=016087f6-293d-4b9c-a3e3-330e2810f774 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:37.757Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=016087f6-293d-4b9c-a3e3-330e2810f774 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=318 EndTimestamp=2021-07-13T00:05:37.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:37.439Z InvocationID=b28ea2b4-3b03-4564-90ff-31162d56b125 ResponseDesc=OK 2021-07-13T00:05:38.873Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9ae456c2-7539-4ae2-9d67-5a9189b51cfa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:38.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:38.872Z InvocationID=96b5a811-9473-44c4-8fc8-462057abdedb 2021-07-13T00:05:38.976Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7149322c-47bf-439d-9d0d-eb78ec2afeb9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:38.976Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:38.976Z InvocationID=03cab659-05ed-4756-9b88-c78838182d98 2021-07-13T00:05:39.119Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9ae456c2-7539-4ae2-9d67-5a9189b51cfa InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:39.159Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7149322c-47bf-439d-9d0d-eb78ec2afeb9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:39.513Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9ae456c2-7539-4ae2-9d67-5a9189b51cfa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=641 EndTimestamp=2021-07-13T00:05:39.513Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:38.872Z InvocationID=17ed5bda-8bb1-44fe-9c12-7ebe3cc3303f ResponseDesc=OK 2021-07-13T00:05:39.559Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7149322c-47bf-439d-9d0d-eb78ec2afeb9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=583 EndTimestamp=2021-07-13T00:05:39.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:38.976Z InvocationID=0eb4a1f8-1b23-44aa-a834-369056d12071 ResponseDesc=OK 2021-07-13T00:05:42.064Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=16aac35a-67a9-485a-bb35-80d03cf13bb9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:42.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:42.064Z InvocationID=61b67f37-cd0d-432e-929b-4710f2032c89 2021-07-13T00:05:42.164Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=16aac35a-67a9-485a-bb35-80d03cf13bb9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:42.358Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=16aac35a-67a9-485a-bb35-80d03cf13bb9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=293 EndTimestamp=2021-07-13T00:05:42.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:42.064Z InvocationID=a564c692-0d57-4beb-93ed-d4252a127f82 ResponseDesc=OK 2021-07-13T00:05:44.763Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=905bbdfd-ef6e-42b9-8ecb-753fda28cbea InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:44.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:44.763Z InvocationID=4f70a2dc-ac0d-4500-b105-5165bbeaf237 2021-07-13T00:05:44.911Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=905bbdfd-ef6e-42b9-8ecb-753fda28cbea InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:45.416Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=905bbdfd-ef6e-42b9-8ecb-753fda28cbea InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=652 EndTimestamp=2021-07-13T00:05:45.415Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:44.763Z InvocationID=b1929fa1-2d7a-44e3-a901-03d095f68351 ResponseDesc=OK 2021-07-13T00:05:47.440Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1f9cf03f-40f1-480e-b9cc-3ac4f75b44e0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:47.440Z InvocationID=65c3e193-1e76-4716-a523-3916f5fa5476 2021-07-13T00:05:47.557Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1f9cf03f-40f1-480e-b9cc-3ac4f75b44e0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:47.766Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=30dbd681-5e7b-4d50-92e1-eaa4fd299ccf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:47.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:47.766Z InvocationID=5132a931-e0dc-4b5d-9084-f218e799f26c 2021-07-13T00:05:47.959Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=30dbd681-5e7b-4d50-92e1-eaa4fd299ccf InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:47.960Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1f9cf03f-40f1-480e-b9cc-3ac4f75b44e0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=519 EndTimestamp=2021-07-13T00:05:47.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:47.440Z InvocationID=37254665-26bf-4f0f-871c-5c2728d54b3c ResponseDesc=OK 2021-07-13T00:05:48.162Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=30dbd681-5e7b-4d50-92e1-eaa4fd299ccf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=396 EndTimestamp=2021-07-13T00:05:48.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:47.766Z InvocationID=e9bb537a-18d8-4405-982b-e999911b6797 ResponseDesc=OK 2021-07-13T00:05:48.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e6777272-ac52-4181-9d1c-b293bc3597f9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:48.873Z InvocationID=527382ae-b8aa-4f0d-8d43-7d9454fabb7d 2021-07-13T00:05:49.115Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e6777272-ac52-4181-9d1c-b293bc3597f9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:49.513Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e6777272-ac52-4181-9d1c-b293bc3597f9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=639 EndTimestamp=2021-07-13T00:05:49.512Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:48.873Z InvocationID=3e2f03c0-6bfd-4a99-8929-047db2a57a49 ResponseDesc=OK 2021-07-13T00:05:50.869Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8713857a-241e-4b0a-b9b6-93520f33ada9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:50.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:50.869Z InvocationID=6ff0333e-9aef-41ad-9c25-28d040a9869b 2021-07-13T00:05:51.057Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8713857a-241e-4b0a-b9b6-93520f33ada9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:51.461Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8713857a-241e-4b0a-b9b6-93520f33ada9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=592 EndTimestamp=2021-07-13T00:05:51.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:50.869Z InvocationID=862b1114-43ff-459b-b425-314d0ed081a9 ResponseDesc=OK 2021-07-13T00:05:54.174Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fc758ff5-fa13-4953-a1fc-1e9ef80653ce InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:54.174Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:54.174Z InvocationID=2040b3db-21b4-4b9d-8316-d7d5ff4dffde 2021-07-13T00:05:54.359Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fc758ff5-fa13-4953-a1fc-1e9ef80653ce InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:54.561Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fc758ff5-fa13-4953-a1fc-1e9ef80653ce InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=387 EndTimestamp=2021-07-13T00:05:54.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:54.174Z InvocationID=53815572-2afb-455b-a7c0-3ad7ff68c80c ResponseDesc=OK 2021-07-13T00:05:56.967Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b5762eec-7cb3-4842-a15c-96b62be16187 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:56.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:56.967Z InvocationID=126e2ff0-146f-4174-88d9-cf86a0431ac7 2021-07-13T00:05:57.214Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b5762eec-7cb3-4842-a15c-96b62be16187 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:57.440Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=76fcf1ec-8493-4c9c-bc80-f21af9d8f90f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:57.439Z InvocationID=29a90017-2025-45a6-800a-30d92d1f55ec 2021-07-13T00:05:57.616Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b5762eec-7cb3-4842-a15c-96b62be16187 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=649 EndTimestamp=2021-07-13T00:05:57.616Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:56.967Z InvocationID=51579f49-6cb9-4847-a141-ae8f2addbea2 ResponseDesc=OK 2021-07-13T00:05:57.858Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=76fcf1ec-8493-4c9c-bc80-f21af9d8f90f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:58.160Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=76fcf1ec-8493-4c9c-bc80-f21af9d8f90f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=721 EndTimestamp=2021-07-13T00:05:58.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:57.439Z InvocationID=3eb7e1b9-d0c7-4435-aaf3-3a3655e65b06 ResponseDesc=OK 2021-07-13T00:05:58.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=18860723-2f89-49dc-8718-47b0698133ba InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:58.873Z InvocationID=31cb8144-7262-4be8-901b-9e128143553a 2021-07-13T00:05:58.960Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=18860723-2f89-49dc-8718-47b0698133ba InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:05:59.158Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=18860723-2f89-49dc-8718-47b0698133ba InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=285 EndTimestamp=2021-07-13T00:05:59.158Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:58.873Z InvocationID=ad453e5c-dc59-43aa-9da9-5044b86ad898 ResponseDesc=OK 2021-07-13T00:05:59.874Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5b25c3df-f4a6-4e05-9a20-039814f0c2f9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:05:59.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:59.873Z InvocationID=28a17472-2f83-494f-91f9-f90697d1d555 2021-07-13T00:06:00.713Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5b25c3df-f4a6-4e05-9a20-039814f0c2f9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:01.123Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5b25c3df-f4a6-4e05-9a20-039814f0c2f9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1250 EndTimestamp=2021-07-13T00:06:01.123Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:05:59.873Z InvocationID=f14e460d-33f0-4729-b2cc-d1a9584e6561 ResponseDesc=OK 2021-07-13T00:06:03.270Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f52f9f1-3a35-414d-a9b4-0535c4f1d257 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:03.270Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:03.270Z InvocationID=022aac5c-6e37-428c-bbe9-99fa6ac450ac 2021-07-13T00:06:03.458Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f52f9f1-3a35-414d-a9b4-0535c4f1d257 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:03.860Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0f52f9f1-3a35-414d-a9b4-0535c4f1d257 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=590 EndTimestamp=2021-07-13T00:06:03.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:03.270Z InvocationID=c4a364cd-c896-4817-912e-36f5a3e4c8f1 ResponseDesc=OK 2021-07-13T00:06:05.968Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=53ae0e4e-a9e6-49c6-805e-1a0ede4daddf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:05.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:05.968Z InvocationID=13c6b640-2721-43c5-af02-159e753fada7 2021-07-13T00:06:06.859Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=53ae0e4e-a9e6-49c6-805e-1a0ede4daddf InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:07.057Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=53ae0e4e-a9e6-49c6-805e-1a0ede4daddf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1089 EndTimestamp=2021-07-13T00:06:07.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:05.968Z InvocationID=f52d46de-7808-4a67-9d5e-c549631abb63 ResponseDesc=OK 2021-07-13T00:06:07.438Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9584e861-32ad-4310-826b-a4c9243fb1d6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:07.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:07.438Z InvocationID=ebe5e834-0933-4a2c-b41d-4a3b4d364df8 2021-07-13T00:06:07.612Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9584e861-32ad-4310-826b-a4c9243fb1d6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:07.767Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9584e861-32ad-4310-826b-a4c9243fb1d6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=329 EndTimestamp=2021-07-13T00:06:07.767Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:07.438Z InvocationID=3d5d84cd-6c10-41b1-8c2c-655ee62e75fc ResponseDesc=OK 2021-07-13T00:06:08.873Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d68897ad-411a-4802-bbee-814137acd9d3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:08.873Z InvocationID=74b59dea-9f7a-400a-bac4-d5e2b3cf3d37 2021-07-13T00:06:09.057Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d68897ad-411a-4802-bbee-814137acd9d3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:09.066Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0a34d2a6-8309-4f81-90c2-98b6ec75db01 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:09.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:09.066Z InvocationID=c607b738-2ed6-42f2-83ba-f28e5615ff4f 2021-07-13T00:06:09.160Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0a34d2a6-8309-4f81-90c2-98b6ec75db01 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:09.457Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0a34d2a6-8309-4f81-90c2-98b6ec75db01 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=391 EndTimestamp=2021-07-13T00:06:09.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:09.066Z InvocationID=aefb20b8-250d-471c-9a34-eb85c9dcc6c2 ResponseDesc=OK 2021-07-13T00:06:09.462Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d68897ad-411a-4802-bbee-814137acd9d3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=589 EndTimestamp=2021-07-13T00:06:09.462Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:08.873Z InvocationID=7de3e97b-48e7-4ba3-a4aa-3559c58d2dab ResponseDesc=OK 2021-07-13T00:06:11.872Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b1b63501-92d4-4458-9284-d3f4c99d6f80 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:11.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:11.871Z InvocationID=fb9c3456-c8e3-445e-bcd9-048f0405f179 2021-07-13T00:06:12.111Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b1b63501-92d4-4458-9284-d3f4c99d6f80 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:12.513Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b1b63501-92d4-4458-9284-d3f4c99d6f80 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=642 EndTimestamp=2021-07-13T00:06:12.513Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:11.871Z InvocationID=1899cc74-c3f3-442d-8ba2-e728b18a6bb2 ResponseDesc=OK 2021-07-13T00:06:15.067Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=626b6f1e-0902-44ae-8fad-a8f31eee84dd InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:15.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:15.067Z InvocationID=22d6d8bc-e755-4a69-8e50-d494af80d87a 2021-07-13T00:06:15.357Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=626b6f1e-0902-44ae-8fad-a8f31eee84dd InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:16.262Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=626b6f1e-0902-44ae-8fad-a8f31eee84dd InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1195 EndTimestamp=2021-07-13T00:06:16.262Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:15.067Z InvocationID=174a92ca-318d-42b9-bfab-4ef35aa1e669 ResponseDesc=OK 2021-07-13T00:06:17.444Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a1cf43ea-d419-4255-bd25-5779d98894ba InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:17.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:17.444Z InvocationID=0fd2f35d-3f01-402a-9bf3-3065d80ca7ba 2021-07-13T00:06:17.659Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a1cf43ea-d419-4255-bd25-5779d98894ba InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:17.857Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a1cf43ea-d419-4255-bd25-5779d98894ba InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=413 EndTimestamp=2021-07-13T00:06:17.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:17.444Z InvocationID=6216fac8-5213-42d4-855a-7cfdc78f7a0b ResponseDesc=OK 2021-07-13T00:06:17.971Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=141f1c3c-da4d-4bd6-9520-38f91d6c9640 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:17.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:17.970Z InvocationID=b67ebebe-5401-4e38-a568-40a697b6953a 2021-07-13T00:06:18.323Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=141f1c3c-da4d-4bd6-9520-38f91d6c9640 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:18.873Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=000cb36d-d907-4e39-817d-447527fae07b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:18.873Z InvocationID=eb07073b-777e-46d4-a040-2b2f7da0f174 2021-07-13T00:06:19.057Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=000cb36d-d907-4e39-817d-447527fae07b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:20.219Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=141f1c3c-da4d-4bd6-9520-38f91d6c9640 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=2249 EndTimestamp=2021-07-13T00:06:20.219Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:17.970Z InvocationID=42cb8545-36de-4788-84a2-f3dc357e32f8 ResponseDesc=OK 2021-07-13T00:06:20.359Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=000cb36d-d907-4e39-817d-447527fae07b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1486 EndTimestamp=2021-07-13T00:06:20.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:18.873Z InvocationID=e7b19972-d1a6-4b13-b7a0-246ecde9883c ResponseDesc=OK 2021-07-13T00:06:21.166Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=77d686ff-6c7a-4dd0-8393-a9e44e0693c4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:21.166Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:21.166Z InvocationID=2d21144a-4dff-4e43-a9e8-c4c62c3e9c3a 2021-07-13T00:06:21.259Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=77d686ff-6c7a-4dd0-8393-a9e44e0693c4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:21.457Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=77d686ff-6c7a-4dd0-8393-a9e44e0693c4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=291 EndTimestamp=2021-07-13T00:06:21.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:21.166Z InvocationID=45086bf6-a036-43ba-80a6-051e8a07c6a4 ResponseDesc=OK 2021-07-13T00:06:23.964Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=88c74542-e134-475e-b7c2-bf3b832fd8e8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:23.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:23.964Z InvocationID=d49acbbd-ce6f-4557-b8db-6d7d9825e45d 2021-07-13T00:06:24.522Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=88c74542-e134-475e-b7c2-bf3b832fd8e8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:25.212Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=88c74542-e134-475e-b7c2-bf3b832fd8e8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1248 EndTimestamp=2021-07-13T00:06:25.212Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:23.964Z InvocationID=87ba9cf6-03a9-4315-8c71-fbced8ec7a25 ResponseDesc=OK 2021-07-13T00:06:26.972Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4314c83d-c6e9-4312-a516-b09fb6374d26 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:26.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:26.971Z InvocationID=8d664af1-ed65-4c70-9bd8-1688af18e78b 2021-07-13T00:06:27.157Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4314c83d-c6e9-4312-a516-b09fb6374d26 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:27.439Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0320cd83-a222-4102-98e6-29382a49dd3d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:27.439Z InvocationID=fad49fde-3d51-4988-a08d-9cbb7a566621 2021-07-13T00:06:27.659Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4314c83d-c6e9-4312-a516-b09fb6374d26 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=688 EndTimestamp=2021-07-13T00:06:27.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:26.971Z InvocationID=4a183733-fe4b-4985-b9d0-624f8246caa1 ResponseDesc=OK 2021-07-13T00:06:27.660Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0320cd83-a222-4102-98e6-29382a49dd3d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:27.958Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0320cd83-a222-4102-98e6-29382a49dd3d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=519 EndTimestamp=2021-07-13T00:06:27.958Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:27.439Z InvocationID=e43c1add-625a-49b7-88a7-5150dd77b127 ResponseDesc=OK 2021-07-13T00:06:28.874Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0e9e5f3d-a4d0-410d-bf27-81def5655d80 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:28.874Z InvocationID=f6d1d742-8b53-4261-8c78-92f706ebf81b 2021-07-13T00:06:29.131Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0e9e5f3d-a4d0-410d-bf27-81def5655d80 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:29.825Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0e9e5f3d-a4d0-410d-bf27-81def5655d80 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=951 EndTimestamp=2021-07-13T00:06:29.825Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:28.874Z InvocationID=cf82517a-e25c-4d81-9cbe-fa544ab53a4d ResponseDesc=OK 2021-07-13T00:06:30.066Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=98ddb9eb-87ce-43c2-bebb-8a5c4f6d85c5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:30.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:30.065Z InvocationID=7a33db82-71b1-4277-a014-55da7c679c74 2021-07-13T00:06:32.957Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=98ddb9eb-87ce-43c2-bebb-8a5c4f6d85c5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:33.361Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=98ddb9eb-87ce-43c2-bebb-8a5c4f6d85c5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=3296 EndTimestamp=2021-07-13T00:06:33.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:30.065Z InvocationID=9ffabf2b-b606-45a1-b814-1016fa98ddd1 ResponseDesc=OK 2021-07-13T00:06:34.443Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=74f4e80c-14d4-47b0-9ece-01788bcfd025 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:34.443Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:34.443Z InvocationID=17dc400e-a7f1-4322-be1b-a61b5e367f95 2021-07-13T00:06:34.663Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=74f4e80c-14d4-47b0-9ece-01788bcfd025 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:34.963Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=74f4e80c-14d4-47b0-9ece-01788bcfd025 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=520 EndTimestamp=2021-07-13T00:06:34.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:34.443Z InvocationID=fcfe8580-df44-41fe-b997-f377bc7751d1 ResponseDesc=OK 2021-07-13T00:06:35.966Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6b78b30c-c5ae-4111-8f5d-6fc50e74e314 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:35.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:35.966Z InvocationID=acfe7506-db17-49ec-bbfe-a7ecf84a2db2 2021-07-13T00:06:36.534Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6b78b30c-c5ae-4111-8f5d-6fc50e74e314 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:36.920Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6b78b30c-c5ae-4111-8f5d-6fc50e74e314 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=954 EndTimestamp=2021-07-13T00:06:36.920Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:35.966Z InvocationID=dbf0da8e-5a05-445d-8878-cd6a1531321e ResponseDesc=OK 2021-07-13T00:06:37.440Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a1bcdb11-b69f-4016-a3c2-22dbe3f81cbb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:37.440Z InvocationID=26f4d902-9b71-4695-83bc-e31e9a434c75 2021-07-13T00:06:37.757Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a1bcdb11-b69f-4016-a3c2-22dbe3f81cbb InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:38.159Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a1bcdb11-b69f-4016-a3c2-22dbe3f81cbb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=719 EndTimestamp=2021-07-13T00:06:38.159Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:37.440Z InvocationID=178f9eda-08bf-4635-9df3-58dd5bf0c910 ResponseDesc=OK 2021-07-13T00:06:38.873Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1463f7f1-5007-40dd-a703-e0b235af83b3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:38.873Z InvocationID=3e7b75dc-43df-4934-824a-20ebb9e754e2 2021-07-13T00:06:39.059Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1463f7f1-5007-40dd-a703-e0b235af83b3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:39.069Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0bffb67f-eed4-43f8-a6fb-b48925495651 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:39.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:39.069Z InvocationID=64634ef8-6c7c-4c22-a442-5bb5ff4513ea 2021-07-13T00:06:39.261Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1463f7f1-5007-40dd-a703-e0b235af83b3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=388 EndTimestamp=2021-07-13T00:06:39.261Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:38.873Z InvocationID=9da99714-7909-47ce-9bcd-df2ad4632f21 ResponseDesc=OK 2021-07-13T00:06:39.323Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0bffb67f-eed4-43f8-a6fb-b48925495651 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:39.716Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0bffb67f-eed4-43f8-a6fb-b48925495651 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=647 EndTimestamp=2021-07-13T00:06:39.716Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:39.069Z InvocationID=f1c067eb-ce55-408b-8c2f-83279fddde4f ResponseDesc=OK 2021-07-13T00:06:41.960Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3de69eee-b51c-4e44-992c-b7f278b919c7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:41.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:41.960Z InvocationID=75fdf182-6e67-495e-a89f-8294c9d87c99 2021-07-13T00:06:42.057Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3de69eee-b51c-4e44-992c-b7f278b919c7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:42.360Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3de69eee-b51c-4e44-992c-b7f278b919c7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=400 EndTimestamp=2021-07-13T00:06:42.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:41.960Z InvocationID=a9e3b591-14d8-42e9-87d7-c7be60a76aba ResponseDesc=OK 2021-07-13T00:06:44.768Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=579dcfce-aebd-4784-bb65-ae4ce3aa0dee InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:44.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:44.768Z InvocationID=517b40c2-4c8c-4113-bf35-2c4ee6b19e17 2021-07-13T00:06:44.861Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=579dcfce-aebd-4784-bb65-ae4ce3aa0dee InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:45.057Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=579dcfce-aebd-4784-bb65-ae4ce3aa0dee InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=289 EndTimestamp=2021-07-13T00:06:45.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:44.768Z InvocationID=7960dc24-8ac7-422e-a5d7-55ee0943272f ResponseDesc=OK 2021-07-13T00:06:47.440Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9435a1b4-a556-4dc0-95ae-a6fffdd3ff94 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:47.439Z InvocationID=bc9b642b-86b4-4899-9f02-1a702a606cef 2021-07-13T00:06:47.619Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9435a1b4-a556-4dc0-95ae-a6fffdd3ff94 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:47.965Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a741782e-a339-4c4e-8c52-38830905f794 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:47.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:47.965Z InvocationID=ee2f2c79-1730-4ca6-a466-1f4d1b35e936 2021-07-13T00:06:48.358Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a741782e-a339-4c4e-8c52-38830905f794 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:48.873Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=73527b27-f16b-46dc-b163-ed5ad54d1875 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:48.873Z InvocationID=ac51e3d8-045d-46d8-a484-1a795673d69f 2021-07-13T00:06:51.360Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=73527b27-f16b-46dc-b163-ed5ad54d1875 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:52.112Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6656bba2-a108-40c4-b5cc-d3a21bc62486 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:52.112Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:52.112Z InvocationID=5ff91f17-97ca-4d80-b689-3cab3f1ec974 2021-07-13T00:06:56.121Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce8ab764-6ccb-44e5-9dfb-da011ceaa7f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:56.121Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:56.121Z InvocationID=3a838d29-f753-40d9-b99a-45f5ee651ad1 2021-07-13T00:06:59.323Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a741782e-a339-4c4e-8c52-38830905f794 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:06:59.325Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=9435a1b4-a556-4dc0-95ae-a6fffdd3ff94 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureCassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:06:59.325Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9435a1b4-a556-4dc0-95ae-a6fffdd3ff94 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:06:59.326Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=9435a1b4-a556-4dc0-95ae-a6fffdd3ff94 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=11887 EndTimestamp=2021-07-13T00:06:59.326Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:47.439Z InvocationID=5a5a6c46-f9b0-40a1-87e8-96df281d2858 ResponseDesc=Internal Server Error 2021-07-13T00:06:59.329Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=874bee94-144f-4002-92ae-6ab50b0b0fa8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:59.329Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:59.329Z InvocationID=e90644dc-9c4d-4d5b-9b6d-95137c040d3e 2021-07-13T00:06:59.361Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce8ab764-6ccb-44e5-9dfb-da011ceaa7f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:59.461Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=73527b27-f16b-46dc-b163-ed5ad54d1875 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=10588 EndTimestamp=2021-07-13T00:06:59.461Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:48.873Z InvocationID=ec07a52c-7494-464f-abf3-8c82d7e97de5 ResponseDesc=OK 2021-07-13T00:06:59.463Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=a741782e-a339-4c4e-8c52-38830905f794 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=11498 EndTimestamp=2021-07-13T00:06:59.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:47.965Z InvocationID=14e9d825-9188-4fb7-8ba6-8e7509c09412 ResponseDesc=Internal Server Error 2021-07-13T00:06:59.464Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=86ae9cfc-c781-47eb-b356-6345658a8cda InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:06:59.464Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:59.464Z InvocationID=ebc51f97-1f45-4a22-854b-f5afed51da63 2021-07-13T00:06:59.465Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=874bee94-144f-4002-92ae-6ab50b0b0fa8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:59.617Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6656bba2-a108-40c4-b5cc-d3a21bc62486 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:06:59.658Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=86ae9cfc-c781-47eb-b356-6345658a8cda InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:00.226Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9bc797fa-e7c7-4ba7-9446-fe452be6b432 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:00.226Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:00.226Z InvocationID=788b839e-c048-4026-8e6e-f9cdeb7e9964 2021-07-13T00:07:04.315Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d252b5b-ad4f-4c68-89eb-9a38e48bb6f1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:04.315Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:04.315Z InvocationID=fef1c434-055d-4a54-b2c6-ddaccc47a7d3 2021-07-13T00:07:05.460Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9bc797fa-e7c7-4ba7-9446-fe452be6b432 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:05.568Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=86ae9cfc-c781-47eb-b356-6345658a8cda InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=6104 EndTimestamp=2021-07-13T00:07:05.568Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:59.464Z InvocationID=3a0ac2ef-3480-4329-abd5-39f4c4fe736f ResponseDesc=OK 2021-07-13T00:07:05.716Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=874bee94-144f-4002-92ae-6ab50b0b0fa8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=6387 EndTimestamp=2021-07-13T00:07:05.716Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:59.329Z InvocationID=6b5e9a26-7389-466c-b043-c6ec2ade263d ResponseDesc=OK 2021-07-13T00:07:05.719Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d252b5b-ad4f-4c68-89eb-9a38e48bb6f1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:05.858Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ce8ab764-6ccb-44e5-9dfb-da011ceaa7f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=9737 EndTimestamp=2021-07-13T00:07:05.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:56.121Z InvocationID=5bc80426-4e60-4c34-a565-075c1853603c ResponseDesc=OK 2021-07-13T00:07:06.257Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2d252b5b-ad4f-4c68-89eb-9a38e48bb6f1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1942 EndTimestamp=2021-07-13T00:07:06.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:04.315Z InvocationID=cf8ea936-b8d6-49a9-9147-b178db4ffca7 ResponseDesc=OK 2021-07-13T00:07:06.274Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6656bba2-a108-40c4-b5cc-d3a21bc62486 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=14162 EndTimestamp=2021-07-13T00:07:06.274Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:06:52.112Z InvocationID=ec7710ea-1d5d-4b3d-96da-f83be058f770 ResponseDesc=OK 2021-07-13T00:07:06.411Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9bc797fa-e7c7-4ba7-9446-fe452be6b432 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=6185 EndTimestamp=2021-07-13T00:07:06.411Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:00.226Z InvocationID=ba348083-d87a-4b6b-b6e9-786468267487 ResponseDesc=OK 2021-07-13T00:07:07.370Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=24dfa52a-7fc1-45e4-b2ab-244eb517b011 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:07.370Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:07.370Z InvocationID=2ddea030-b3c1-4f6c-bb1c-63a29ae558c2 2021-07-13T00:07:07.377Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=24dfa52a-7fc1-45e4-b2ab-244eb517b011 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:07.439Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4b071cd5-b346-4a1e-a0cd-96a99890c8bf ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:07:07.439Z ElapsedTime=0 EndTimestamp=2021-07-13T00:07:07.439Z InvocationID=d60ddced-bdad-454c-9774-aedd5f009ba5 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:07:07.465Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4b071cd5-b346-4a1e-a0cd-96a99890c8bf InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:07.480Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=24dfa52a-7fc1-45e4-b2ab-244eb517b011 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=110 EndTimestamp=2021-07-13T00:07:07.480Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:07.370Z InvocationID=235a66fd-9672-42e0-9ed4-058dfca3d421 ResponseDesc=OK 2021-07-13T00:07:07.566Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4b071cd5-b346-4a1e-a0cd-96a99890c8bf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=127 EndTimestamp=2021-07-13T00:07:07.566Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:07.439Z InvocationID=83fb1497-defe-4747-9798-e18f67482b9a ResponseDesc=OK 2021-07-13T00:07:08.581Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e3b5b8a-5a2a-4175-8b6e-66928b39e919 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:08.581Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:08.581Z InvocationID=fd7e3e36-129c-4930-b520-c83a5a810a4b 2021-07-13T00:07:08.759Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e3b5b8a-5a2a-4175-8b6e-66928b39e919 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:08.874Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fac4d329-9863-4137-9140-f7f03254a301 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:08.874Z InvocationID=0f242c74-3bb8-4d32-ba45-38b4e425f18d 2021-07-13T00:07:09.156Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e3b5b8a-5a2a-4175-8b6e-66928b39e919 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=575 EndTimestamp=2021-07-13T00:07:09.156Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:08.581Z InvocationID=17e7fda2-af99-45c5-b725-7d0aa2d2467a ResponseDesc=OK 2021-07-13T00:07:09.313Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fac4d329-9863-4137-9140-f7f03254a301 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:09.819Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fac4d329-9863-4137-9140-f7f03254a301 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=945 EndTimestamp=2021-07-13T00:07:09.819Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:08.874Z InvocationID=3b3dcc81-e064-4662-b8b2-b2b94b7ca1ce ResponseDesc=OK 2021-07-13T00:07:10.173Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0e2dc47e-5d78-43c8-972f-7b96dc263eb6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:10.173Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:10.173Z InvocationID=1c905850-f9f8-4ff3-b0ae-17e16a63d3dd 2021-07-13T00:07:10.456Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0e2dc47e-5d78-43c8-972f-7b96dc263eb6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:10.573Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0e2dc47e-5d78-43c8-972f-7b96dc263eb6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=400 EndTimestamp=2021-07-13T00:07:10.573Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:10.173Z InvocationID=f51352f5-d9ff-4424-af08-ff5e21b6ea84 ResponseDesc=OK 2021-07-13T00:07:11.769Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2ec70249-3614-4a8a-8fd4-f6487d343f45 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:07:11.769Z ElapsedTime=0 EndTimestamp=2021-07-13T00:07:11.769Z InvocationID=98c1cb7a-1ccd-457b-b8a1-2c83d951e1a7 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:07:11.860Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2ec70249-3614-4a8a-8fd4-f6487d343f45 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:12.058Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2ec70249-3614-4a8a-8fd4-f6487d343f45 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=289 EndTimestamp=2021-07-13T00:07:12.058Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:11.769Z InvocationID=ff84dbf7-a4e1-4340-be5d-45b432d8a6b9 ResponseDesc=OK 2021-07-13T00:07:14.978Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c3eca787-3de7-4841-a96f-3cbb8f48ffbb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:14.978Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:14.978Z InvocationID=574058d8-a78f-40de-a9e7-f7e010857a90 2021-07-13T00:07:15.212Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c3eca787-3de7-4841-a96f-3cbb8f48ffbb InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:15.712Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c3eca787-3de7-4841-a96f-3cbb8f48ffbb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=734 EndTimestamp=2021-07-13T00:07:15.712Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:14.978Z InvocationID=f059dfbb-850d-4edc-8eee-1a5548e167f7 ResponseDesc=OK 2021-07-13T00:07:17.440Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=461140c8-54b6-4d1c-8967-5c71c159cff3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:17.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:17.440Z InvocationID=9ef1b479-af41-45b4-a2bc-f2c6ab5fcb2e 2021-07-13T00:07:17.759Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=461140c8-54b6-4d1c-8967-5c71c159cff3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:18.160Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=461140c8-54b6-4d1c-8967-5c71c159cff3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=720 EndTimestamp=2021-07-13T00:07:18.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:17.440Z InvocationID=8718ab18-238d-48c4-9933-e8cc73db075d ResponseDesc=OK 2021-07-13T00:07:18.366Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f2bd1b80-ac3d-45ed-b05d-a46b83d056d6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:18.366Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:18.366Z InvocationID=18b9bf28-3d6a-4c3f-bc99-5aaad9934755 2021-07-13T00:07:18.460Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f2bd1b80-ac3d-45ed-b05d-a46b83d056d6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:18.873Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e4ab7279-42ca-495c-9090-d0600a84cfcf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:18.873Z InvocationID=d1d90a83-d63e-4684-8bde-41f1c0bf367c 2021-07-13T00:07:19.157Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f2bd1b80-ac3d-45ed-b05d-a46b83d056d6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=791 EndTimestamp=2021-07-13T00:07:19.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:18.366Z InvocationID=99c60600-4935-4784-b002-8de38f46889c ResponseDesc=OK 2021-07-13T00:07:19.317Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e4ab7279-42ca-495c-9090-d0600a84cfcf InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:19.814Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e4ab7279-42ca-495c-9090-d0600a84cfcf InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=941 EndTimestamp=2021-07-13T00:07:19.814Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:18.873Z InvocationID=137fe781-7c8e-4a9b-b516-758dcda82104 ResponseDesc=OK 2021-07-13T00:07:20.771Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9650cbfb-6572-4349-8626-f5611104f4fc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:20.771Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:20.771Z InvocationID=65a97a76-c37a-4990-9cee-c190ab494d25 2021-07-13T00:07:20.956Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9650cbfb-6572-4349-8626-f5611104f4fc InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:21.360Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9650cbfb-6572-4349-8626-f5611104f4fc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=589 EndTimestamp=2021-07-13T00:07:21.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:20.771Z InvocationID=737b1112-8faf-47b8-99d8-960fc3b47626 ResponseDesc=OK 2021-07-13T00:07:23.865Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fb0bf59e-3f9e-444b-814a-630816bdc2ca InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:23.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:23.865Z InvocationID=db086eb5-33e3-4914-bbe7-1ac8d007aebf 2021-07-13T00:07:23.960Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fb0bf59e-3f9e-444b-814a-630816bdc2ca InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:24.158Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fb0bf59e-3f9e-444b-814a-630816bdc2ca InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=293 EndTimestamp=2021-07-13T00:07:24.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:23.865Z InvocationID=c7aae722-2abc-4e77-a492-5e6f6e85d542 ResponseDesc=OK 2021-07-13T00:07:26.772Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c34df0e1-71fa-4cb1-9aff-704b1772ff8f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:26.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:26.772Z InvocationID=1ae953af-117a-47a4-8e8d-117a5db28355 2021-07-13T00:07:27.016Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c34df0e1-71fa-4cb1-9aff-704b1772ff8f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:27.413Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c34df0e1-71fa-4cb1-9aff-704b1772ff8f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=641 EndTimestamp=2021-07-13T00:07:27.413Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:26.772Z InvocationID=21eec52a-4a1b-44e1-b85c-c29db6f44221 ResponseDesc=OK 2021-07-13T00:07:27.440Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=55f3de3f-4fed-4bf1-938c-b73e32d661eb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:27.439Z InvocationID=d0f34922-d1bd-4a7b-a694-9bd8fcff7ba9 2021-07-13T00:07:27.559Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=55f3de3f-4fed-4bf1-938c-b73e32d661eb InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:27.959Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=55f3de3f-4fed-4bf1-938c-b73e32d661eb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=520 EndTimestamp=2021-07-13T00:07:27.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:27.439Z InvocationID=e6f6a2bd-d856-43ef-8440-e435c3284a13 ResponseDesc=OK 2021-07-13T00:07:28.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da54e66d-f924-4a84-aac9-faf0bd5b3e87 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:28.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:28.872Z InvocationID=86c9aad0-48cf-4139-862b-5abcc5d3d4ea 2021-07-13T00:07:29.059Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da54e66d-f924-4a84-aac9-faf0bd5b3e87 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:29.657Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da54e66d-f924-4a84-aac9-faf0bd5b3e87 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=785 EndTimestamp=2021-07-13T00:07:29.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:28.872Z InvocationID=44acae22-1649-4299-bdcc-1c103576d15f ResponseDesc=OK 2021-07-13T00:07:30.470Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7775a0ac-8eeb-4448-97fd-fb8fb43de00d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:30.470Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:30.470Z InvocationID=66a333f4-f5a8-4646-96fb-299dc1bee997 2021-07-13T00:07:30.711Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7775a0ac-8eeb-4448-97fd-fb8fb43de00d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:31.117Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7775a0ac-8eeb-4448-97fd-fb8fb43de00d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=647 EndTimestamp=2021-07-13T00:07:31.117Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:30.470Z InvocationID=5cf0ea20-b4e9-4bd2-aa16-0177ee3f8b2c ResponseDesc=OK 2021-07-13T00:07:32.774Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=06d50ce6-b69f-41da-9fbb-fe37d86de237 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:32.774Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:32.774Z InvocationID=2fb2f822-8127-495d-a3e2-4657cb009742 2021-07-13T00:07:32.957Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=06d50ce6-b69f-41da-9fbb-fe37d86de237 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:33.060Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=06d50ce6-b69f-41da-9fbb-fe37d86de237 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=286 EndTimestamp=2021-07-13T00:07:33.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:32.774Z InvocationID=b8f2fa80-c9c8-474e-bed2-8d4ae1ed7755 ResponseDesc=OK 2021-07-13T00:07:35.967Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a4d19cb7-256d-4224-b4aa-67c9ad184861 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:35.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:35.967Z InvocationID=fe344b52-3491-4a70-8875-81d3fc86ecc4 2021-07-13T00:07:36.159Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a4d19cb7-256d-4224-b4aa-67c9ad184861 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:37.440Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ba0625c9-4e10-4f76-9a39-21842efec862 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:37.440Z InvocationID=0631c1ad-6e7f-41fb-a7d2-41db673db813 2021-07-13T00:07:37.957Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a4d19cb7-256d-4224-b4aa-67c9ad184861 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1990 EndTimestamp=2021-07-13T00:07:37.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:35.967Z InvocationID=d8773d7b-3b88-4f98-9909-cdc4085e44dd ResponseDesc=OK 2021-07-13T00:07:38.011Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ba0625c9-4e10-4f76-9a39-21842efec862 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:38.415Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ba0625c9-4e10-4f76-9a39-21842efec862 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=975 EndTimestamp=2021-07-13T00:07:38.415Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:37.440Z InvocationID=ca55002e-b7aa-4f5e-8c7c-bca01da740e1 ResponseDesc=OK 2021-07-13T00:07:38.873Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d120b0c0-9bb4-4fdf-8a35-b956bde92c08 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:38.873Z InvocationID=4b3356bb-4f47-4701-8702-5d65af7edd88 2021-07-13T00:07:39.057Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d120b0c0-9bb4-4fdf-8a35-b956bde92c08 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:39.162Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=36132f1b-5341-4921-b1f6-a0102412a04a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:39.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:39.162Z InvocationID=98ee679b-ba24-4f7c-98c6-8ccbc3afbb6c 2021-07-13T00:07:39.259Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=36132f1b-5341-4921-b1f6-a0102412a04a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:39.458Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=36132f1b-5341-4921-b1f6-a0102412a04a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=296 EndTimestamp=2021-07-13T00:07:39.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:39.162Z InvocationID=4339f02b-c311-40b6-a13b-514b919c7440 ResponseDesc=OK 2021-07-13T00:07:39.459Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d120b0c0-9bb4-4fdf-8a35-b956bde92c08 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=586 EndTimestamp=2021-07-13T00:07:39.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:38.873Z InvocationID=fd3e81a6-6c9b-4d60-ae08-34cdb4e2e67e ResponseDesc=OK 2021-07-13T00:07:41.675Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=91d179bc-d8a1-42c2-ab46-7b8ce4da38f0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:41.675Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:41.675Z InvocationID=f22d9a36-20be-4a1d-90cb-7afdbb9c8c14 2021-07-13T00:07:42.059Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=91d179bc-d8a1-42c2-ab46-7b8ce4da38f0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:42.320Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=91d179bc-d8a1-42c2-ab46-7b8ce4da38f0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=645 EndTimestamp=2021-07-13T00:07:42.320Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:41.675Z InvocationID=b58bc790-27b9-4c3c-819d-ae20cecff7d6 ResponseDesc=OK 2021-07-13T00:07:45.068Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=489ac0a0-fc82-4306-9c83-ad661681a231 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:45.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:45.067Z InvocationID=fb66d2ba-a917-450f-8957-94cb08e0b9c4 2021-07-13T00:07:45.257Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=489ac0a0-fc82-4306-9c83-ad661681a231 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:45.961Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=489ac0a0-fc82-4306-9c83-ad661681a231 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=894 EndTimestamp=2021-07-13T00:07:45.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:45.067Z InvocationID=2bf644e6-4240-436f-a30d-8a276f00863a ResponseDesc=OK 2021-07-13T00:07:47.439Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8bfd5dd9-7ea3-4bde-ab5b-d4b6616902ea InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:47.439Z InvocationID=7f75037d-d076-4ae1-a1e7-9220381bdabd 2021-07-13T00:07:47.559Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8bfd5dd9-7ea3-4bde-ab5b-d4b6616902ea InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:47.758Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8bfd5dd9-7ea3-4bde-ab5b-d4b6616902ea InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=319 EndTimestamp=2021-07-13T00:07:47.758Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:47.439Z InvocationID=d720a2b1-05ce-4f4e-adab-8850b261edd8 ResponseDesc=OK 2021-07-13T00:07:47.775Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c696e413-3b99-420a-8ab2-e0fa884788f3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:47.774Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:47.774Z InvocationID=f7252882-4c04-4971-9da4-bcf34468d7cc 2021-07-13T00:07:48.013Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c696e413-3b99-420a-8ab2-e0fa884788f3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:48.414Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c696e413-3b99-420a-8ab2-e0fa884788f3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=640 EndTimestamp=2021-07-13T00:07:48.414Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:47.774Z InvocationID=460374ce-370a-4ae5-bd3e-dbe97dd036c3 ResponseDesc=OK 2021-07-13T00:07:48.874Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8309a61f-88cc-422f-89b4-947a734347e1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:48.873Z InvocationID=5822c6a6-6d12-4e2c-b9ea-a76ad6106336 2021-07-13T00:07:49.057Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8309a61f-88cc-422f-89b4-947a734347e1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:49.463Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8309a61f-88cc-422f-89b4-947a734347e1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=589 EndTimestamp=2021-07-13T00:07:49.462Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:48.873Z InvocationID=e0cadcd8-5220-43c6-8258-14b65ca14c90 ResponseDesc=OK 2021-07-13T00:07:50.864Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c0082c6a-80da-4ff3-a590-e6c390ebcb57 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:50.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:50.864Z InvocationID=e301c818-30d0-4c31-927b-6077306a6d0c 2021-07-13T00:07:50.960Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c0082c6a-80da-4ff3-a590-e6c390ebcb57 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:51.157Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c0082c6a-80da-4ff3-a590-e6c390ebcb57 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=293 EndTimestamp=2021-07-13T00:07:51.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:50.864Z InvocationID=f2d453d1-bca1-4d59-a8ed-76b654e3bbdb ResponseDesc=OK 2021-07-13T00:07:53.963Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=35dd3b95-99f2-4c40-817c-45cec748b291 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:53.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:53.963Z InvocationID=639bbabb-f496-46c3-909a-f30048c8fbe0 2021-07-13T00:07:54.067Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=35dd3b95-99f2-4c40-817c-45cec748b291 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:54.169Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=35dd3b95-99f2-4c40-817c-45cec748b291 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=206 EndTimestamp=2021-07-13T00:07:54.169Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:53.963Z InvocationID=82cd9e21-7077-427e-a5ed-27c5ac076bff ResponseDesc=OK 2021-07-13T00:07:57.163Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=521d68ab-c03f-41b5-b00e-5673db7ed5bc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:57.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:57.163Z InvocationID=61a49ac5-e05d-4ce3-b925-0a515d14f30d 2021-07-13T00:07:57.444Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2045e0fc-846d-4dde-b8d5-97dbe191da90 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:57.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:57.444Z InvocationID=bf89514c-bde0-4360-8298-80c58f7f2e32 2021-07-13T00:07:57.556Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=521d68ab-c03f-41b5-b00e-5673db7ed5bc InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:57.611Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2045e0fc-846d-4dde-b8d5-97dbe191da90 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:57.760Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=521d68ab-c03f-41b5-b00e-5673db7ed5bc InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=597 EndTimestamp=2021-07-13T00:07:57.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:57.163Z InvocationID=d41598ea-aea9-4515-ba61-90462206e093 ResponseDesc=OK 2021-07-13T00:07:57.860Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2045e0fc-846d-4dde-b8d5-97dbe191da90 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=416 EndTimestamp=2021-07-13T00:07:57.860Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:57.444Z InvocationID=a20800bf-3984-4f63-b549-dc8472106f9c ResponseDesc=OK 2021-07-13T00:07:58.873Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4f2be5de-29ef-421d-af58-eceaf17e7e29 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:07:58.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:58.872Z InvocationID=14cae98f-a069-497a-97a7-4ef6de6db05f 2021-07-13T00:07:59.112Z [qtp817348612-42] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4f2be5de-29ef-421d-af58-eceaf17e7e29 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:07:59.516Z [qtp817348612-42] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4f2be5de-29ef-421d-af58-eceaf17e7e29 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=644 EndTimestamp=2021-07-13T00:07:59.516Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:07:58.872Z InvocationID=a2f671a4-d436-4a80-b4d5-72c35109a595 ResponseDesc=OK 2021-07-13T00:08:00.161Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=efe1170b-a940-460f-8b72-86897b1854c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:00.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:00.161Z InvocationID=dde8e54e-28be-4814-a1f7-7af08379055e 2021-07-13T00:08:00.259Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=efe1170b-a940-460f-8b72-86897b1854c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:00.459Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=efe1170b-a940-460f-8b72-86897b1854c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=298 EndTimestamp=2021-07-13T00:08:00.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:00.161Z InvocationID=66ee2836-2c32-4a07-9bdd-7f6fd4f9124b ResponseDesc=OK 2021-07-13T00:08:02.769Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cabbbb97-2097-4c64-9c8d-932c636f6466 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:02.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:02.768Z InvocationID=cab95a5d-67fb-435c-b13f-d820bd395f21 2021-07-13T00:08:02.861Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cabbbb97-2097-4c64-9c8d-932c636f6466 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:03.057Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cabbbb97-2097-4c64-9c8d-932c636f6466 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=289 EndTimestamp=2021-07-13T00:08:03.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:02.768Z InvocationID=0a286960-be03-48a3-9df7-b8b92791d827 ResponseDesc=OK 2021-07-13T00:08:06.267Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=68d14e30-6da3-451a-b0b1-e874e9cc5f1a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:06.267Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:06.267Z InvocationID=8e3c4d1b-7efa-4399-8fb0-e4d0a7e5ef16 2021-07-13T00:08:06.513Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=68d14e30-6da3-451a-b0b1-e874e9cc5f1a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:07.018Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=68d14e30-6da3-451a-b0b1-e874e9cc5f1a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=751 EndTimestamp=2021-07-13T00:08:07.018Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:06.267Z InvocationID=3c6122d7-2477-40b1-a0da-a7496b8fbe3c ResponseDesc=OK 2021-07-13T00:08:07.439Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=42959f96-1075-465a-b9a6-42c7022db183 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:07.439Z InvocationID=0acc7d5b-3c9f-40bc-ae8d-8cabb439d77f 2021-07-13T00:08:07.558Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=42959f96-1075-465a-b9a6-42c7022db183 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:08.060Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=42959f96-1075-465a-b9a6-42c7022db183 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=621 EndTimestamp=2021-07-13T00:08:08.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:07.439Z InvocationID=fe80177b-f0c2-464f-8d5b-2dcd66a4f88a ResponseDesc=OK 2021-07-13T00:08:08.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d68613a4-964d-46f4-a400-3fa425224ead InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:08.873Z InvocationID=f0e1d015-0dbe-4fd3-86b3-09741e23ed70 2021-07-13T00:08:09.063Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d68613a4-964d-46f4-a400-3fa425224ead InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:09.257Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d68613a4-964d-46f4-a400-3fa425224ead InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=384 EndTimestamp=2021-07-13T00:08:09.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:08.873Z InvocationID=bc571b1f-9671-4706-839b-97925a862054 ResponseDesc=OK 2021-07-13T00:08:09.260Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=94170f4f-ec55-4f5b-af15-ad5662b8838b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:09.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:09.260Z InvocationID=2784e119-abe6-4385-bedf-0c62d81aa7cd 2021-07-13T00:08:09.611Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=94170f4f-ec55-4f5b-af15-ad5662b8838b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:10.015Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=94170f4f-ec55-4f5b-af15-ad5662b8838b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=755 EndTimestamp=2021-07-13T00:08:10.015Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:09.260Z InvocationID=6b545ca6-38b2-4bb6-bda7-935f3597d61b ResponseDesc=OK 2021-07-13T00:08:11.764Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=64bb1875-2c03-4c9b-8068-6d5485fee5b9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:11.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:11.764Z InvocationID=4d9a7620-1f4a-4a4a-b127-af7be621e26b 2021-07-13T00:08:11.860Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=64bb1875-2c03-4c9b-8068-6d5485fee5b9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:12.367Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=64bb1875-2c03-4c9b-8068-6d5485fee5b9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=603 EndTimestamp=2021-07-13T00:08:12.367Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:11.764Z InvocationID=e445f933-3838-477e-8271-717ac09e1bcf ResponseDesc=OK 2021-07-13T00:08:14.859Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a1408a49-0a9b-4e74-b356-a96930c96d63 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:14.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:14.859Z InvocationID=f8542f01-9552-411f-85dc-09529a46e955 2021-07-13T00:08:15.059Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a1408a49-0a9b-4e74-b356-a96930c96d63 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:15.258Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a1408a49-0a9b-4e74-b356-a96930c96d63 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=399 EndTimestamp=2021-07-13T00:08:15.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:14.859Z InvocationID=00e4371d-7c57-4bcb-a7da-05b6862be525 ResponseDesc=OK 2021-07-13T00:08:17.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=edd4b572-a1b8-4868-bf84-6af3b3d4af0b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:17.439Z InvocationID=8b6452c3-ef1a-4eac-9266-b07992648a40 2021-07-13T00:08:17.727Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=edd4b572-a1b8-4868-bf84-6af3b3d4af0b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:18.015Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=edd4b572-a1b8-4868-bf84-6af3b3d4af0b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=576 EndTimestamp=2021-07-13T00:08:18.015Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:17.439Z InvocationID=a713691b-3d6a-4f41-944d-87ca5836b23e ResponseDesc=OK 2021-07-13T00:08:18.062Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3137bc4d-b594-41aa-91d1-14b9580aa955 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:18.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:18.062Z InvocationID=783e0220-f84a-4a2a-95bc-8425decd1f93 2021-07-13T00:08:18.256Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3137bc4d-b594-41aa-91d1-14b9580aa955 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:18.873Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f3a7c6dd-18d6-4509-b2c9-57cf0cb304df InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:18.873Z InvocationID=c5da327b-1624-4ba0-9bb5-a39aa36b161e 2021-07-13T00:08:18.959Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f3a7c6dd-18d6-4509-b2c9-57cf0cb304df InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:19.059Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3137bc4d-b594-41aa-91d1-14b9580aa955 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=997 EndTimestamp=2021-07-13T00:08:19.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:18.062Z InvocationID=afa949e0-4ea9-413f-ba8e-1843504c01b7 ResponseDesc=OK 2021-07-13T00:08:19.159Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f3a7c6dd-18d6-4509-b2c9-57cf0cb304df InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=286 EndTimestamp=2021-07-13T00:08:19.159Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:18.873Z InvocationID=5ad0c46b-6ba1-427d-ac79-384d888fc08a ResponseDesc=OK 2021-07-13T00:08:21.166Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=59f6b0b9-89f5-45b8-b082-e30bff8579b0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:21.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:21.165Z InvocationID=aee21fa7-d9a5-4025-9ed8-5d3b294dadaf 2021-07-13T00:08:21.414Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=59f6b0b9-89f5-45b8-b082-e30bff8579b0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:21.815Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=59f6b0b9-89f5-45b8-b082-e30bff8579b0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=650 EndTimestamp=2021-07-13T00:08:21.815Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:21.165Z InvocationID=9637c638-610f-405b-8e2c-59434f040ff0 ResponseDesc=OK 2021-07-13T00:08:23.966Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3dc0e636-d636-43e0-a236-2ce766ee8592 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:23.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:23.965Z InvocationID=a0f92f36-2d69-487e-b9ac-a9d99df267a5 2021-07-13T00:08:24.157Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3dc0e636-d636-43e0-a236-2ce766ee8592 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:24.561Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3dc0e636-d636-43e0-a236-2ce766ee8592 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=596 EndTimestamp=2021-07-13T00:08:24.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:23.965Z InvocationID=e956d5a8-fde4-42db-8d61-b5e1b780586f ResponseDesc=OK 2021-07-13T00:08:26.771Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ca6b535f-bc17-4e8d-a340-1faf74f4334b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:26.771Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:26.771Z InvocationID=c1ca10ce-6990-4060-85fc-ff503a35b83a 2021-07-13T00:08:26.859Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ca6b535f-bc17-4e8d-a340-1faf74f4334b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:27.057Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ca6b535f-bc17-4e8d-a340-1faf74f4334b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=286 EndTimestamp=2021-07-13T00:08:27.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:26.771Z InvocationID=a27d4f94-7af2-4471-9a08-456e7db4a485 ResponseDesc=OK 2021-07-13T00:08:27.445Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7e007dd3-8769-44e7-af5d-162f25b390d3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:27.445Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:27.445Z InvocationID=a9a7dfd0-3484-4fca-9337-bbea4def2279 2021-07-13T00:08:27.746Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7e007dd3-8769-44e7-af5d-162f25b390d3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:28.015Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7e007dd3-8769-44e7-af5d-162f25b390d3 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=570 EndTimestamp=2021-07-13T00:08:28.015Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:27.445Z InvocationID=fbb5aa51-fa59-43f6-9d89-a22cf16c530a ResponseDesc=OK 2021-07-13T00:08:28.873Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=41ed4a0c-2e4a-489a-b0ac-b15d2e0e9b50 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:28.873Z InvocationID=97ed0e3b-2f0b-4567-a039-b3dcae52683e 2021-07-13T00:08:29.157Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=41ed4a0c-2e4a-489a-b0ac-b15d2e0e9b50 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:29.661Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=41ed4a0c-2e4a-489a-b0ac-b15d2e0e9b50 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=788 EndTimestamp=2021-07-13T00:08:29.661Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:28.873Z InvocationID=e4eac7fd-daef-470c-ab6f-470f88ee98c7 ResponseDesc=OK 2021-07-13T00:08:30.273Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8da85c23-aaf2-42fe-962a-59007a67af0a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:30.273Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:30.273Z InvocationID=2d5d1b73-8a6a-4d83-94e3-eef56eb4e13f 2021-07-13T00:08:30.560Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8da85c23-aaf2-42fe-962a-59007a67af0a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:30.757Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8da85c23-aaf2-42fe-962a-59007a67af0a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=484 EndTimestamp=2021-07-13T00:08:30.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:30.273Z InvocationID=e2fc82c3-eb5d-476f-8c12-a5be92b12424 ResponseDesc=OK 2021-07-13T00:08:32.772Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c9d6b76d-4efb-4f43-ab40-c2173c838bdb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:32.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:32.772Z InvocationID=ba1659a2-f2cb-45c6-8f13-7d88ff8583e0 2021-07-13T00:08:33.491Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c9d6b76d-4efb-4f43-ab40-c2173c838bdb InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:33.919Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c9d6b76d-4efb-4f43-ab40-c2173c838bdb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1147 EndTimestamp=2021-07-13T00:08:33.919Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:32.772Z InvocationID=a79805b5-16c5-4221-bbdd-46ca054fb456 ResponseDesc=OK 2021-07-13T00:08:35.966Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bf1e9925-e37f-43da-8646-4f253a899211 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:35.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:35.966Z InvocationID=9cf0dd52-e0f4-41f6-ac46-cd0f4f9fb2f3 2021-07-13T00:08:36.072Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bf1e9925-e37f-43da-8646-4f253a899211 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:36.459Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bf1e9925-e37f-43da-8646-4f253a899211 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=493 EndTimestamp=2021-07-13T00:08:36.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:35.966Z InvocationID=52bcf9f7-81cc-433c-9650-c72b4224ad1d ResponseDesc=OK 2021-07-13T00:08:37.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7263ec60-25d0-4f8a-a382-cd79f336c853 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:37.439Z InvocationID=8ce78b63-c652-4546-90d4-60319f836950 2021-07-13T00:08:37.558Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7263ec60-25d0-4f8a-a382-cd79f336c853 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:37.666Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7263ec60-25d0-4f8a-a382-cd79f336c853 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=227 EndTimestamp=2021-07-13T00:08:37.666Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:37.439Z InvocationID=8b5d169f-032e-49e4-b359-28a1bbfd44b9 ResponseDesc=OK 2021-07-13T00:08:38.873Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bf85d177-80f6-4b54-af80-581480b21917 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:38.873Z InvocationID=c9c57a0e-b898-4316-979d-94aebe9d21fe 2021-07-13T00:08:38.973Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cab3fcca-c0be-4476-bea0-70874990f500 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:38.973Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:38.973Z InvocationID=b136bb3c-6601-4289-97a9-6efe6bbb3df6 2021-07-13T00:08:40.661Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cab3fcca-c0be-4476-bea0-70874990f500 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:40.711Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bf85d177-80f6-4b54-af80-581480b21917 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:41.033Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cab3fcca-c0be-4476-bea0-70874990f500 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=2060 EndTimestamp=2021-07-13T00:08:41.033Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:38.973Z InvocationID=ed06732d-edc3-4fb3-855b-7a57154a90e5 ResponseDesc=OK 2021-07-13T00:08:41.059Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bf85d177-80f6-4b54-af80-581480b21917 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=2186 EndTimestamp=2021-07-13T00:08:41.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:38.873Z InvocationID=f4406b82-b659-4ff9-8dd7-a86a7348e233 ResponseDesc=OK 2021-07-13T00:08:41.963Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6ec22fa0-f0e4-480a-93c7-36a237f75174 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:41.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:41.963Z InvocationID=14bc527b-8537-4757-a089-eca261417e77 2021-07-13T00:08:42.559Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6ec22fa0-f0e4-480a-93c7-36a237f75174 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:42.757Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6ec22fa0-f0e4-480a-93c7-36a237f75174 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=794 EndTimestamp=2021-07-13T00:08:42.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:41.963Z InvocationID=20e82951-06f4-4252-8a7a-949bb15e553b ResponseDesc=OK 2021-07-13T00:08:45.064Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4350e98f-8e71-4c19-bd0e-fc27be4717f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:45.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:45.064Z InvocationID=d60d1bf2-999b-4bf8-8447-d4e437050de7 2021-07-13T00:08:45.721Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4350e98f-8e71-4c19-bd0e-fc27be4717f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:45.859Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4350e98f-8e71-4c19-bd0e-fc27be4717f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=795 EndTimestamp=2021-07-13T00:08:45.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:45.064Z InvocationID=41b045f7-a155-46a0-aebb-c6c6f5cb357a ResponseDesc=OK 2021-07-13T00:08:47.442Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=75ee331a-a108-480f-b4e5-448c59e755ca InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:47.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:47.442Z InvocationID=2a1eba83-a398-4d1c-85f2-eac6a8dd31ce 2021-07-13T00:08:47.612Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=75ee331a-a108-480f-b4e5-448c59e755ca InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:47.673Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=17d4772e-8504-470e-b76c-965463ca0fb2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:47.673Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:47.673Z InvocationID=689c1ec6-ab60-4711-b415-110cf0b7bea0 2021-07-13T00:08:47.859Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=17d4772e-8504-470e-b76c-965463ca0fb2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:47.874Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=75ee331a-a108-480f-b4e5-448c59e755ca InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=431 EndTimestamp=2021-07-13T00:08:47.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:47.442Z InvocationID=e820f335-6c97-45fd-ba5a-12fa46d699be ResponseDesc=OK 2021-07-13T00:08:48.257Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=17d4772e-8504-470e-b76c-965463ca0fb2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=584 EndTimestamp=2021-07-13T00:08:48.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:47.673Z InvocationID=11e95ec0-8233-4ace-81d0-0de97baeeee3 ResponseDesc=OK 2021-07-13T00:08:48.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f9a26573-903d-4eb4-8881-b17295f3c2d5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:48.873Z InvocationID=61373587-52d1-419f-a14e-c13c3107c56a 2021-07-13T00:08:50.011Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f9a26573-903d-4eb4-8881-b17295f3c2d5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:50.423Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f9a26573-903d-4eb4-8881-b17295f3c2d5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1550 EndTimestamp=2021-07-13T00:08:50.423Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:48.873Z InvocationID=fd2d33b6-777a-4928-a94d-1aa3f8d90ae6 ResponseDesc=OK 2021-07-13T00:08:50.864Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=66e40a03-0f34-4ca5-aeb0-20d5e4c58228 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:50.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:50.864Z InvocationID=5f058038-3695-416f-b6a3-b6955bbf208b 2021-07-13T00:08:50.957Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=66e40a03-0f34-4ca5-aeb0-20d5e4c58228 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:51.660Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=66e40a03-0f34-4ca5-aeb0-20d5e4c58228 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=796 EndTimestamp=2021-07-13T00:08:51.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:50.864Z InvocationID=71c0a14f-a872-40bf-8d5c-6b02893f127d ResponseDesc=OK 2021-07-13T00:08:53.565Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f8eb6b63-c045-43d3-9862-ac80fc437508 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:53.565Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:53.565Z InvocationID=cc482c9d-54a6-47a6-95ad-70407c62e058 2021-07-13T00:08:53.660Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f8eb6b63-c045-43d3-9862-ac80fc437508 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:53.857Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f8eb6b63-c045-43d3-9862-ac80fc437508 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=292 EndTimestamp=2021-07-13T00:08:53.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:53.565Z InvocationID=4cdedcda-f2f9-49ab-9e0c-ac42e920c9df ResponseDesc=OK 2021-07-13T00:08:56.868Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=56cf2f78-9f5c-4aa7-a153-be48384b1ce0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:56.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:56.868Z InvocationID=2f8e6edf-0317-43b4-b934-f1caa84879f6 2021-07-13T00:08:57.438Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d91b05f-ef1b-4536-90d5-0fcb70a32b83 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:57.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:57.438Z InvocationID=eaae46d3-ccd3-4437-af7f-59de658638a5 2021-07-13T00:08:57.968Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d91b05f-ef1b-4536-90d5-0fcb70a32b83 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:58.127Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=56cf2f78-9f5c-4aa7-a153-be48384b1ce0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:58.316Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2d91b05f-ef1b-4536-90d5-0fcb70a32b83 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=878 EndTimestamp=2021-07-13T00:08:58.316Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:57.438Z InvocationID=caca6ec6-7ed8-4be7-b8f4-96ba315bd604 ResponseDesc=OK 2021-07-13T00:08:58.460Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=56cf2f78-9f5c-4aa7-a153-be48384b1ce0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1591 EndTimestamp=2021-07-13T00:08:58.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:56.868Z InvocationID=580ac438-7b79-4518-93d1-29b2b47b4062 ResponseDesc=OK 2021-07-13T00:08:58.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=52d19a71-93d2-4240-b008-1e0309502789 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:58.873Z InvocationID=b4cbecfe-e678-4354-b0af-669de7b41eab 2021-07-13T00:08:59.159Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=52d19a71-93d2-4240-b008-1e0309502789 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:08:59.357Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=52d19a71-93d2-4240-b008-1e0309502789 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=484 EndTimestamp=2021-07-13T00:08:59.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:58.873Z InvocationID=160cdf66-a5e3-478c-8856-ff994eb5e7e2 ResponseDesc=OK 2021-07-13T00:08:59.768Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2c25ade3-1b75-4a45-92a1-3a47984f9001 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:08:59.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:59.768Z InvocationID=21c088b3-cb15-4751-9b7a-eb5e57d7cd4a 2021-07-13T00:09:01.123Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2c25ade3-1b75-4a45-92a1-3a47984f9001 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:01.915Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2c25ade3-1b75-4a45-92a1-3a47984f9001 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=2147 EndTimestamp=2021-07-13T00:09:01.915Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:08:59.768Z InvocationID=4e5bedf8-0622-42b8-803c-845cc598ef29 ResponseDesc=OK 2021-07-13T00:09:03.165Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=72bba55a-50d2-4921-8514-02829295d28b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:03.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:03.165Z InvocationID=d483b598-74b5-40a0-903b-69c6a2af5791 2021-07-13T00:09:03.359Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=72bba55a-50d2-4921-8514-02829295d28b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:04.661Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=72bba55a-50d2-4921-8514-02829295d28b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1496 EndTimestamp=2021-07-13T00:09:04.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:03.165Z InvocationID=380dc27e-9a62-432c-af9a-9654c91d1b3a ResponseDesc=OK 2021-07-13T00:09:06.175Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=20f7fb40-103d-42cb-98c3-8ea28738c311 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:06.175Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:06.175Z InvocationID=b4caff6f-9dbb-4736-81c1-f47de3becbf7 2021-07-13T00:09:06.360Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=20f7fb40-103d-42cb-98c3-8ea28738c311 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:06.558Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=20f7fb40-103d-42cb-98c3-8ea28738c311 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=383 EndTimestamp=2021-07-13T00:09:06.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:06.175Z InvocationID=9c64e8d5-f6eb-47fc-8ba6-7a41a512c836 ResponseDesc=OK 2021-07-13T00:09:07.449Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=af2395f9-4207-42b2-8251-b1d4cc1c30b9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:07.449Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:07.449Z InvocationID=d23bbe08-1549-4b08-bc91-f6feca2224fb 2021-07-13T00:09:07.826Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=af2395f9-4207-42b2-8251-b1d4cc1c30b9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:08.312Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=af2395f9-4207-42b2-8251-b1d4cc1c30b9 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=863 EndTimestamp=2021-07-13T00:09:08.312Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:07.449Z InvocationID=28896159-de08-42c7-8bd4-ad2768c4a0f5 ResponseDesc=OK 2021-07-13T00:09:08.873Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8ee3be1e-10b9-486f-a279-1e7d664b436d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:08.873Z InvocationID=7a52debf-004e-4c08-b92e-f7c4793ade74 2021-07-13T00:09:09.069Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fb83b122-7cb1-4aa1-8d0e-abfd0666ed46 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:09.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:09.069Z InvocationID=76edc780-7fca-4c4b-8cbc-8a7efa7b8ca6 2021-07-13T00:09:09.156Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8ee3be1e-10b9-486f-a279-1e7d664b436d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:13.212Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f38cb6f1-9e7a-474a-9fd4-947497fd5389 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:13.212Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:13.212Z InvocationID=58710fba-e6e7-491f-8dae-a0711d2f89b0 2021-07-13T00:09:14.359Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f38cb6f1-9e7a-474a-9fd4-947497fd5389 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:14.414Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fb83b122-7cb1-4aa1-8d0e-abfd0666ed46 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:14.471Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8ee3be1e-10b9-486f-a279-1e7d664b436d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=5598 EndTimestamp=2021-07-13T00:09:14.471Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:08.873Z InvocationID=e2093d7b-671a-45cd-89c5-29b61689222d ResponseDesc=OK 2021-07-13T00:09:14.657Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fb83b122-7cb1-4aa1-8d0e-abfd0666ed46 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=5588 EndTimestamp=2021-07-13T00:09:14.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:09.069Z InvocationID=7112e83e-9384-48a0-b2c0-86abbe483446 ResponseDesc=OK 2021-07-13T00:09:14.819Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f38cb6f1-9e7a-474a-9fd4-947497fd5389 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1607 EndTimestamp=2021-07-13T00:09:14.819Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:13.212Z InvocationID=86818fc4-f424-47a8-9ca6-35761095bd12 ResponseDesc=OK 2021-07-13T00:09:15.865Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fb013937-b86b-4998-970f-fa9d8e60b3b7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:15.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:15.865Z InvocationID=0498388d-d7f2-4682-9ab7-984df4fe3bcd 2021-07-13T00:09:16.057Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fb013937-b86b-4998-970f-fa9d8e60b3b7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:17.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1588e37e-7fab-406c-93cd-76dd6181c8bb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:17.439Z InvocationID=2eb1c418-53b8-44da-88e9-717312d5c94c 2021-07-13T00:09:18.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=66c61654-7be4-4831-b746-4dcd2bb72deb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:18.873Z InvocationID=9622a8f5-c151-4071-bb29-d716581ce762 2021-07-13T00:09:19.358Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=66c61654-7be4-4831-b746-4dcd2bb72deb InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:19.364Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1588e37e-7fab-406c-93cd-76dd6181c8bb InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:19.666Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fb013937-b86b-4998-970f-fa9d8e60b3b7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=3800 EndTimestamp=2021-07-13T00:09:19.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:15.865Z InvocationID=923e1bd9-f0db-4a49-9f48-3ce8f5ee83a9 ResponseDesc=OK 2021-07-13T00:09:19.859Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1588e37e-7fab-406c-93cd-76dd6181c8bb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=2420 EndTimestamp=2021-07-13T00:09:19.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:17.439Z InvocationID=7382f18c-e792-448d-be5c-0faed30bd275 ResponseDesc=OK 2021-07-13T00:09:20.323Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=66c61654-7be4-4831-b746-4dcd2bb72deb InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1450 EndTimestamp=2021-07-13T00:09:20.323Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:18.873Z InvocationID=e87d281a-8be8-442d-856f-260023fc97fb ResponseDesc=OK 2021-07-13T00:09:20.411Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b2d503af-badf-42c6-8c85-d81787c513b8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:20.411Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:20.411Z InvocationID=9cdf10f0-9787-4891-affa-3aae383fddc1 2021-07-13T00:09:20.557Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b2d503af-badf-42c6-8c85-d81787c513b8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:20.860Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b2d503af-badf-42c6-8c85-d81787c513b8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=449 EndTimestamp=2021-07-13T00:09:20.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:20.411Z InvocationID=02075f23-b0dd-49c8-8569-ca9b44db6646 ResponseDesc=OK 2021-07-13T00:09:22.066Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c3667729-0502-4217-abb9-60e0194ab53e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:22.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:22.066Z InvocationID=a260c523-2c3f-4598-b03e-ce86422dafa7 2021-07-13T00:09:22.160Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c3667729-0502-4217-abb9-60e0194ab53e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:22.357Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c3667729-0502-4217-abb9-60e0194ab53e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=291 EndTimestamp=2021-07-13T00:09:22.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:22.066Z InvocationID=f98a913d-d07b-4a90-8509-1f164102ee69 ResponseDesc=OK 2021-07-13T00:09:23.575Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f8483f30-f829-462d-aa47-bca2a542d7d5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:23.575Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:23.575Z InvocationID=285b1503-bfa0-48c0-859d-2a6652ef8d6a 2021-07-13T00:09:23.816Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f8483f30-f829-462d-aa47-bca2a542d7d5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:27.440Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bdcf8535-aa61-4eb8-b303-7e71d14799f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:27.439Z InvocationID=0d236f85-5049-443d-8a2a-98cdba76f1a6 2021-07-13T00:09:27.898Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=03a6d9a6-778e-4e84-873b-2a57ce60a685 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:27.898Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:27.898Z InvocationID=f7dd0da6-05ce-43ec-a9f2-8329a74e9a0a 2021-07-13T00:09:28.873Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=965b7db8-9a2f-46df-8ffa-2472e856c489 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:28.873Z InvocationID=683dc5ea-458b-46ed-afb2-dcf80194731e 2021-07-13T00:09:32.092Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=566b91f1-7d23-4a9d-918f-970d553a8a5b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:32.092Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:32.092Z InvocationID=a32c180e-872c-475e-9d6c-041cc7157726 2021-07-13T00:09:33.863Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f8483f30-f829-462d-aa47-bca2a542d7d5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:09:36.107Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8f174b1e-6a8b-4fb2-af29-10825a0dc7ef ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:09:36.107Z ElapsedTime=0 EndTimestamp=2021-07-13T00:09:36.107Z InvocationID=f9e9d67b-975c-487d-b370-d9b3cde71101 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:09:37.461Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bdcf8535-aa61-4eb8-b303-7e71d14799f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:09:38.972Z [qtp817348612-53] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=965b7db8-9a2f-46df-8ffa-2472e856c489 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:09:39.933Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=03a6d9a6-778e-4e84-873b-2a57ce60a685 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:09:40.493Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=460a2ffc-dd65-42ff-9bda-279c744b97e1 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:09:40.493Z ElapsedTime=0 EndTimestamp=2021-07-13T00:09:40.493Z InvocationID=e26ee113-1266-4817-b04b-a72557207823 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:09:42.159Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=566b91f1-7d23-4a9d-918f-970d553a8a5b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:42.440Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f97527fa-d465-48a3-91c5-c1ab1a6fed10 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:42.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:42.440Z InvocationID=eb31cae4-0cbd-4834-9591-0ea926a3b789 2021-07-13T00:09:42.483Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=566b91f1-7d23-4a9d-918f-970d553a8a5b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=10391 EndTimestamp=2021-07-13T00:09:42.483Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:32.092Z InvocationID=61317396-609d-43de-8a51-78a41c374450 ResponseDesc=OK 2021-07-13T00:09:43.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=562fe360-accd-4bf0-8eec-e1118558d9a7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:43.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:43.873Z InvocationID=ee758735-11c0-4a6b-ae38-d30918f0df2f 2021-07-13T00:09:44.362Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=460a2ffc-dd65-42ff-9bda-279c744b97e1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:44.363Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=965b7db8-9a2f-46df-8ffa-2472e856c489 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=15490 EndTimestamp=2021-07-13T00:09:44.363Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:28.873Z InvocationID=f42cc68f-12c5-49f4-b45d-734eb0560c6d ResponseDesc=Internal Server Error 2021-07-13T00:09:44.607Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2f955b8b-c646-43d3-bc18-87264f3cc989 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:44.607Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:44.607Z InvocationID=7c255387-53a0-4c2c-a217-27693344cf0b 2021-07-13T00:09:45.062Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=562fe360-accd-4bf0-8eec-e1118558d9a7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:45.360Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=562fe360-accd-4bf0-8eec-e1118558d9a7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1486 EndTimestamp=2021-07-13T00:09:45.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:43.873Z InvocationID=edc12cba-6e1a-44cc-b24f-29f8160b5c14 ResponseDesc=OK 2021-07-13T00:09:45.951Z [qtp817348612-47] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=f8483f30-f829-462d-aa47-bca2a542d7d5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:09:45.952Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f8483f30-f829-462d-aa47-bca2a542d7d5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:09:45.952Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f8483f30-f829-462d-aa47-bca2a542d7d5 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=22377 EndTimestamp=2021-07-13T00:09:45.952Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:23.575Z InvocationID=03ff348f-02c8-4f41-afa2-c48c56725777 ResponseDesc=Internal Server Error 2021-07-13T00:09:48.131Z [qtp817348612-55] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8f174b1e-6a8b-4fb2-af29-10825a0dc7ef InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:09:48.607Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=411bfc44-4caa-4ee4-9769-b2366400523a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:48.607Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:48.607Z InvocationID=7a9fd1cb-23d0-4ab4-b160-e710810936d3 2021-07-13T00:09:48.873Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c9dd23a6-4bf9-4609-8a20-05f6228b8ec8 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:09:48.873Z ElapsedTime=0 EndTimestamp=2021-07-13T00:09:48.873Z InvocationID=6b61b456-e423-4326-96f7-62a2af2490f9 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:09:52.032Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=03a6d9a6-778e-4e84-873b-2a57ce60a685 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:09:52.710Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=939c2e13-15d8-48f1-bdfb-9ea6db8c5f6a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:52.710Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:52.710Z InvocationID=00329692-1396-4393-b3da-4dc28cdd8aa0 2021-07-13T00:09:53.212Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f97527fa-d465-48a3-91c5-c1ab1a6fed10 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:09:53.262Z [qtp817348612-57] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c9dd23a6-4bf9-4609-8a20-05f6228b8ec8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:53.859Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=939c2e13-15d8-48f1-bdfb-9ea6db8c5f6a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:53.859Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=03a6d9a6-778e-4e84-873b-2a57ce60a685 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=25961 EndTimestamp=2021-07-13T00:09:53.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:27.898Z InvocationID=83c8949c-86f3-448f-8725-ff2e9d0f7689 ResponseDesc=Internal Server Error 2021-07-13T00:09:54.157Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=939c2e13-15d8-48f1-bdfb-9ea6db8c5f6a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1447 EndTimestamp=2021-07-13T00:09:54.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:52.710Z InvocationID=18b6a62e-98cf-4154-b931-def9a532ef59 ResponseDesc=OK 2021-07-13T00:09:55.463Z [qtp817348612-58] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c99de8c5-8e61-4a55-ad03-bf18183a007e ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:09:55.463Z ElapsedTime=0 EndTimestamp=2021-07-13T00:09:55.463Z InvocationID=861acd20-4669-42f5-9137-f4c0a9a537b6 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:09:56.413Z [qtp817348612-53] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2f955b8b-c646-43d3-bc18-87264f3cc989 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:09:56.420Z [qtp817348612-54] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=bdcf8535-aa61-4eb8-b303-7e71d14799f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureCassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:09:56.421Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=bdcf8535-aa61-4eb8-b303-7e71d14799f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:09:56.421Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=bdcf8535-aa61-4eb8-b303-7e71d14799f4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=28982 EndTimestamp=2021-07-13T00:09:56.421Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:27.439Z InvocationID=463e8c31-32f0-4dc7-bdf5-54316c18b37b ResponseDesc=Internal Server Error 2021-07-13T00:09:56.462Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=8f174b1e-6a8b-4fb2-af29-10825a0dc7ef InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=20355 EndTimestamp=2021-07-13T00:09:56.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:36.107Z InvocationID=21779e3d-911b-49b1-a371-05661e89db51 ResponseDesc=Internal Server Error 2021-07-13T00:09:56.519Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=411bfc44-4caa-4ee4-9769-b2366400523a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:09:57.440Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=241015d8-86c1-4c27-8f8a-2cfc56df933b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:57.440Z InvocationID=c9f44ee5-8c46-412e-a299-c7949a63619a 2021-07-13T00:09:59.422Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2b2f46e3-ce9e-452c-8328-1931627713aa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:09:59.422Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:59.422Z InvocationID=6e33d80c-883d-43b3-aa56-438d3e8a2c03 2021-07-13T00:10:02.057Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=411bfc44-4caa-4ee4-9769-b2366400523a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=13450 EndTimestamp=2021-07-13T00:10:02.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:48.607Z InvocationID=4803884a-0f50-4e40-9acc-89974a7622fa ResponseDesc=OK 2021-07-13T00:10:02.261Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2b2f46e3-ce9e-452c-8328-1931627713aa InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:02.262Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f97527fa-d465-48a3-91c5-c1ab1a6fed10 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=19822 EndTimestamp=2021-07-13T00:10:02.262Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:42.440Z InvocationID=846cba7d-8908-477a-9f6d-856be372097e ResponseDesc=Internal Server Error 2021-07-13T00:10:02.316Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c9dd23a6-4bf9-4609-8a20-05f6228b8ec8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=13443 EndTimestamp=2021-07-13T00:10:02.316Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:48.873Z InvocationID=6d19832d-8d1b-4822-a234-15dfd4947b3a ResponseDesc=OK 2021-07-13T00:10:02.316Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=460a2ffc-dd65-42ff-9bda-279c744b97e1 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=21823 EndTimestamp=2021-07-13T00:10:02.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:40.493Z InvocationID=f7471cfe-b84e-4740-b7f2-719fa7b37a00 ResponseDesc=OK 2021-07-13T00:10:02.319Z [qtp817348612-58] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c99de8c5-8e61-4a55-ad03-bf18183a007e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:02.320Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d955d733-573d-49a1-b2ad-15ad9b6805c7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:02.320Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:02.320Z InvocationID=d9c2bac1-4a45-4687-945e-c21c81f59d57 2021-07-13T00:10:02.419Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=241015d8-86c1-4c27-8f8a-2cfc56df933b InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:02.860Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2b2f46e3-ce9e-452c-8328-1931627713aa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=3437 EndTimestamp=2021-07-13T00:10:02.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:59.422Z InvocationID=83b88e98-2ed3-4657-9348-525148d0ffc6 ResponseDesc=OK 2021-07-13T00:10:03.459Z [qtp817348612-55] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d955d733-573d-49a1-b2ad-15ad9b6805c7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:03.508Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b1017e4f-ca55-41d4-b595-3d422271634f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:03.508Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:03.508Z InvocationID=ba19434d-3743-4d85-934a-5d4a4a3e9b7a 2021-07-13T00:10:03.717Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=2f955b8b-c646-43d3-bc18-87264f3cc989 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=19110 EndTimestamp=2021-07-13T00:10:03.717Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:44.607Z InvocationID=ca5454e5-2907-47aa-94a9-13bebfafe0d3 ResponseDesc=Internal Server Error 2021-07-13T00:10:03.760Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b1017e4f-ca55-41d4-b595-3d422271634f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:03.861Z [qtp817348612-58] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c99de8c5-8e61-4a55-ad03-bf18183a007e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=8398 EndTimestamp=2021-07-13T00:10:03.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:55.463Z InvocationID=6943651b-8482-4c24-b0e3-ea294b1de74e ResponseDesc=OK 2021-07-13T00:10:04.419Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=241015d8-86c1-4c27-8f8a-2cfc56df933b InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=6979 EndTimestamp=2021-07-13T00:10:04.419Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:09:57.440Z InvocationID=c50287d4-f72b-4a17-99ba-7f51c871de35 ResponseDesc=OK 2021-07-13T00:10:04.461Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b1017e4f-ca55-41d4-b595-3d422271634f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=953 EndTimestamp=2021-07-13T00:10:04.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:03.508Z InvocationID=7c39895f-3fd6-40c2-8599-29d456263a43 ResponseDesc=OK 2021-07-13T00:10:04.557Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d955d733-573d-49a1-b2ad-15ad9b6805c7 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=2237 EndTimestamp=2021-07-13T00:10:04.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:02.320Z InvocationID=eb35bf62-687e-4ca8-80df-0ba83ea16068 ResponseDesc=OK 2021-07-13T00:10:05.764Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5107deb-8ca1-454c-8a90-d37dafe06cca InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:05.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:05.764Z InvocationID=476195d9-97fa-48cf-ac11-519a89ee9466 2021-07-13T00:10:07.438Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3ade364f-a2de-4853-919c-1aa6e050ec64 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:07.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:07.438Z InvocationID=44d8cb7a-ef74-4510-b339-3d9a11489653 2021-07-13T00:10:07.559Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3ade364f-a2de-4853-919c-1aa6e050ec64 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:07.635Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5107deb-8ca1-454c-8a90-d37dafe06cca InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:08.866Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f5107deb-8ca1-454c-8a90-d37dafe06cca InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=3102 EndTimestamp=2021-07-13T00:10:08.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:05.764Z InvocationID=8ab817e8-f50f-40e1-9a38-8a1061d3064f ResponseDesc=OK 2021-07-13T00:10:08.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b6221f18-a6c9-46f8-bfc0-1a7c076f34e8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:08.873Z InvocationID=feb2ba9d-f016-4a00-a1df-7adfa458de37 2021-07-13T00:10:08.912Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3ade364f-a2de-4853-919c-1aa6e050ec64 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=1474 EndTimestamp=2021-07-13T00:10:08.912Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:07.438Z InvocationID=af9a0708-d287-4315-9619-d069164ed19f ResponseDesc=OK 2021-07-13T00:10:09.060Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b6221f18-a6c9-46f8-bfc0-1a7c076f34e8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:09.259Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b6221f18-a6c9-46f8-bfc0-1a7c076f34e8 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=385 EndTimestamp=2021-07-13T00:10:09.258Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:08.873Z InvocationID=0beb3216-d329-4019-b1b4-8f09e6faff25 ResponseDesc=OK 2021-07-13T00:10:10.009Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2cf4e998-f8aa-4e1e-a50f-f93e3c839822 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:10.008Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:10.008Z InvocationID=4a7d1d40-f94b-48f3-b79e-344fea5e498f 2021-07-13T00:10:10.211Z [qtp817348612-55] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2cf4e998-f8aa-4e1e-a50f-f93e3c839822 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:10.615Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2cf4e998-f8aa-4e1e-a50f-f93e3c839822 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=607 EndTimestamp=2021-07-13T00:10:10.615Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:10.008Z InvocationID=84beb2e6-b52b-4816-b513-6916be05fd3b ResponseDesc=OK 2021-07-13T00:10:11.572Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b0b8779e-9366-42ef-beb7-d1897ed41513 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:11.572Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:11.572Z InvocationID=77e041d7-6c07-4f99-97c3-c89b1c275637 2021-07-13T00:10:11.758Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b0b8779e-9366-42ef-beb7-d1897ed41513 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:12.160Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b0b8779e-9366-42ef-beb7-d1897ed41513 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=588 EndTimestamp=2021-07-13T00:10:12.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:11.572Z InvocationID=1ac01bd6-0c09-4896-8aec-90535c3c213c ResponseDesc=OK 2021-07-13T00:10:13.169Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b76a9cec-2a05-453d-b274-f446230865c4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:13.169Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:13.169Z InvocationID=dfbe2e4f-3acc-48a0-a4a9-71b85f027c44 2021-07-13T00:10:13.260Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b76a9cec-2a05-453d-b274-f446230865c4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:13.658Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b76a9cec-2a05-453d-b274-f446230865c4 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=489 EndTimestamp=2021-07-13T00:10:13.658Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:13.169Z InvocationID=36cec0aa-855d-49a6-a38d-eb1947265c13 ResponseDesc=OK 2021-07-13T00:10:14.765Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=49a8acc2-91aa-4f17-a912-92b1126f16bd InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:14.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:14.765Z InvocationID=de721b9e-b2b4-4974-ae69-4e5463204755 2021-07-13T00:10:17.445Z [qtp817348612-58] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=533199e6-36a4-46da-be1e-ba722941ce4c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:17.445Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:17.445Z InvocationID=3beb584b-a365-4174-b769-2c87767481bf 2021-07-13T00:10:18.873Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=75843287-fd13-46e7-88ea-4b5d92410f3f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:18.873Z InvocationID=bde9dcad-74c5-4e62-884f-ca68c6f8806e 2021-07-13T00:10:19.009Z [qtp817348612-59] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=edf155a0-8ba6-4abe-8cd4-e89a0f2f197a ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:10:19.009Z ElapsedTime=0 EndTimestamp=2021-07-13T00:10:19.009Z InvocationID=b1413270-73d3-4158-bf12-851bb658af05 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:10:23.011Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=76d6661e-358c-4ddb-bbbf-f4a97447f17a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:23.011Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:23.011Z InvocationID=6cb46fff-e5da-4b16-9c1f-291636959a8c 2021-07-13T00:10:26.835Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=49a8acc2-91aa-4f17-a912-92b1126f16bd InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:27.208Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a4d6d746-a17e-434e-b243-e88a5ce0fc6f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:27.208Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:27.208Z InvocationID=bd20cbc2-2f0c-452f-babf-8f45da5097e9 2021-07-13T00:10:27.464Z [qtp817348612-58] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=533199e6-36a4-46da-be1e-ba722941ce4c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:28.962Z [qtp817348612-47] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=75843287-fd13-46e7-88ea-4b5d92410f3f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:31.032Z [qtp817348612-59] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=edf155a0-8ba6-4abe-8cd4-e89a0f2f197a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:32.101Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5ebb317c-55b5-43eb-a1ff-903ffd446b91 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:32.100Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:32.100Z InvocationID=99614510-1e0e-4604-8f68-4f6617157bfa 2021-07-13T00:10:32.439Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4314a86a-0557-45b0-993c-2a3bdacf9255 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:32.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:32.439Z InvocationID=a5764a14-bd70-45fb-a90d-d3b47d21365c 2021-07-13T00:10:33.065Z [qtp817348612-53] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=76d6661e-358c-4ddb-bbbf-f4a97447f17a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:33.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6186fa86-d938-4ace-ba7c-0d7567441ae0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:33.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:33.873Z InvocationID=da51e326-475f-47f0-9507-c1fa2d9b4507 2021-07-13T00:10:33.966Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6186fa86-d938-4ace-ba7c-0d7567441ae0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:35.471Z [qtp817348612-54] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=49a8acc2-91aa-4f17-a912-92b1126f16bd InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:35.471Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=49a8acc2-91aa-4f17-a912-92b1126f16bd InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:35.472Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=49a8acc2-91aa-4f17-a912-92b1126f16bd InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=20707 EndTimestamp=2021-07-13T00:10:35.472Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:14.765Z InvocationID=b51417a3-219f-4bf1-a140-b142f4cd7806 ResponseDesc=Internal Server Error 2021-07-13T00:10:36.637Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9bd5dea9-fe8d-4577-97ae-bfdfa1a1d89d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:36.636Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:36.636Z InvocationID=1c79453c-4d39-4e17-8c47-08b697093ac6 2021-07-13T00:10:37.062Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4314a86a-0557-45b0-993c-2a3bdacf9255 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:10:37.078Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4314a86a-0557-45b0-993c-2a3bdacf9255 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:39.231Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a4d6d746-a17e-434e-b243-e88a5ce0fc6f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:40.802Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ee217afd-76f3-4709-9dfd-809fc94a8e28 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:40.802Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:40.802Z InvocationID=d7d4f901-cc23-41c6-92ec-34fbac1340dc 2021-07-13T00:10:42.161Z [qtp817348612-13] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5ebb317c-55b5-43eb-a1ff-903ffd446b91 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:42.172Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5ebb317c-55b5-43eb-a1ff-903ffd446b91 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:42.268Z [qtp817348612-13] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=5ebb317c-55b5-43eb-a1ff-903ffd446b91 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:42.268Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5ebb317c-55b5-43eb-a1ff-903ffd446b91 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:42.268Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=5ebb317c-55b5-43eb-a1ff-903ffd446b91 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=10168 EndTimestamp=2021-07-13T00:10:42.268Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:32.100Z InvocationID=23b5409a-661c-4510-8c17-fe3e16670229 ResponseDesc=Internal Server Error 2021-07-13T00:10:43.131Z [qtp817348612-59] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=edf155a0-8ba6-4abe-8cd4-e89a0f2f197a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:44.906Z [qtp817348612-60] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3749d2a3-252a-4378-825f-2b80161a5ca6 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:10:44.906Z ElapsedTime=0 EndTimestamp=2021-07-13T00:10:44.906Z InvocationID=0e85ab65-304c-4402-be9c-c8ced7400f55 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:10:45.131Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=76d6661e-358c-4ddb-bbbf-f4a97447f17a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:46.031Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=6186fa86-d938-4ace-ba7c-0d7567441ae0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:46.060Z [qtp817348612-11] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=6186fa86-d938-4ace-ba7c-0d7567441ae0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:46.060Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=6186fa86-d938-4ace-ba7c-0d7567441ae0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:46.061Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=6186fa86-d938-4ace-ba7c-0d7567441ae0 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=12187 EndTimestamp=2021-07-13T00:10:46.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:33.873Z InvocationID=b6b836cf-926d-4e9b-a787-36b77273013d ResponseDesc=Internal Server Error 2021-07-13T00:10:46.063Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2c8c4f12-f124-4966-8eb7-09e0aff8acbe InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:46.063Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:46.063Z InvocationID=42b1c577-665a-4792-bb29-d03190bff038 2021-07-13T00:10:47.439Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3ba37999-9fad-41f5-924c-309ba934a667 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:47.439Z InvocationID=b41b3553-4bc2-4991-a0e4-411f8adde9f2 2021-07-13T00:10:47.465Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3ba37999-9fad-41f5-924c-309ba934a667 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:47.551Z [qtp817348612-47] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=75843287-fd13-46e7-88ea-4b5d92410f3f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:47.551Z [qtp817348612-58] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=533199e6-36a4-46da-be1e-ba722941ce4c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:47.551Z [qtp817348612-58] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=533199e6-36a4-46da-be1e-ba722941ce4c InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:47.551Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=75843287-fd13-46e7-88ea-4b5d92410f3f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:47.552Z [qtp817348612-58] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=533199e6-36a4-46da-be1e-ba722941ce4c InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=30107 EndTimestamp=2021-07-13T00:10:47.552Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:17.445Z InvocationID=e7e2bcae-9d24-4ab9-a5df-15cb1211d328 ResponseDesc=Internal Server Error 2021-07-13T00:10:47.552Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=75843287-fd13-46e7-88ea-4b5d92410f3f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=28679 EndTimestamp=2021-07-13T00:10:47.552Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:18.873Z InvocationID=d0205d88-2e07-4884-bcef-d8b147188665 ResponseDesc=Internal Server Error 2021-07-13T00:10:48.731Z [qtp817348612-55] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9bd5dea9-fe8d-4577-97ae-bfdfa1a1d89d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:49.152Z [qtp817348612-56] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=4314a86a-0557-45b0-993c-2a3bdacf9255 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:49.152Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4314a86a-0557-45b0-993c-2a3bdacf9255 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:49.153Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=4314a86a-0557-45b0-993c-2a3bdacf9255 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=16714 EndTimestamp=2021-07-13T00:10:49.153Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:32.439Z InvocationID=1ed054b1-8cf5-444b-a434-d1ad6a118441 ResponseDesc=Internal Server Error 2021-07-13T00:10:49.237Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bdb0235e-5907-488f-b578-1f368209bd05 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:49.237Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:49.237Z InvocationID=4ef6b2f7-6136-4b16-919d-8877b320b996 2021-07-13T00:10:49.261Z [qtp817348612-47] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bdb0235e-5907-488f-b578-1f368209bd05 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:51.333Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a4d6d746-a17e-434e-b243-e88a5ce0fc6f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:52.665Z [qtp817348612-59] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=edf155a0-8ba6-4abe-8cd4-e89a0f2f197a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:52.665Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=a4d6d746-a17e-434e-b243-e88a5ce0fc6f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:52.665Z [qtp817348612-53] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=76d6661e-358c-4ddb-bbbf-f4a97447f17a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:52.665Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a4d6d746-a17e-434e-b243-e88a5ce0fc6f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:52.665Z [qtp817348612-59] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=edf155a0-8ba6-4abe-8cd4-e89a0f2f197a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:52.665Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=76d6661e-358c-4ddb-bbbf-f4a97447f17a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:52.667Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=a4d6d746-a17e-434e-b243-e88a5ce0fc6f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=25459 EndTimestamp=2021-07-13T00:10:52.667Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:27.208Z InvocationID=88f6c8d3-d537-4683-bcc1-f73ec0f76fe4 ResponseDesc=Internal Server Error 2021-07-13T00:10:52.667Z [qtp817348612-59] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=edf155a0-8ba6-4abe-8cd4-e89a0f2f197a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=33658 EndTimestamp=2021-07-13T00:10:52.667Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:19.009Z InvocationID=106e8b84-6d3c-4b8b-ab57-54d42ba33a94 ResponseDesc=Internal Server Error 2021-07-13T00:10:52.667Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=76d6661e-358c-4ddb-bbbf-f4a97447f17a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=29656 EndTimestamp=2021-07-13T00:10:52.667Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:23.011Z InvocationID=da961c48-a9ca-4707-8127-a3d9ab831a31 ResponseDesc=Internal Server Error 2021-07-13T00:10:52.929Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ee217afd-76f3-4709-9dfd-809fc94a8e28 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:53.396Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1dba79d7-5027-4544-b824-d189a8a878c6 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:10:53.396Z ElapsedTime=0 EndTimestamp=2021-07-13T00:10:53.396Z InvocationID=9c86971a-21a1-45cb-ae8b-4a1da61a2a44 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:10:53.465Z [qtp817348612-62] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1dba79d7-5027-4544-b824-d189a8a878c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.035Z [qtp817348612-60] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3749d2a3-252a-4378-825f-2b80161a5ca6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:54.035Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3ba37999-9fad-41f5-924c-309ba934a667 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:54.035Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ee217afd-76f3-4709-9dfd-809fc94a8e28 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:54.035Z [qtp817348612-55] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9bd5dea9-fe8d-4577-97ae-bfdfa1a1d89d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:54.035Z [qtp817348612-57] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2c8c4f12-f124-4966-8eb7-09e0aff8acbe InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:54.035Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=bdb0235e-5907-488f-b578-1f368209bd05 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:54.035Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1dba79d7-5027-4544-b824-d189a8a878c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:10:54.060Z [qtp817348612-54] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=3ba37999-9fad-41f5-924c-309ba934a667 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:10:54.060Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3ba37999-9fad-41f5-924c-309ba934a667 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:10:54.060Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=ee217afd-76f3-4709-9dfd-809fc94a8e28 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:10:54.060Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ee217afd-76f3-4709-9dfd-809fc94a8e28 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:10:54.060Z [qtp817348612-60] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3749d2a3-252a-4378-825f-2b80161a5ca6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:10:54.061Z [qtp817348612-57] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=2c8c4f12-f124-4966-8eb7-09e0aff8acbe InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.061Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=ee217afd-76f3-4709-9dfd-809fc94a8e28 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=13258 EndTimestamp=2021-07-13T00:10:54.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:40.802Z InvocationID=8db9e56a-7ebe-4a24-8ccc-a51d63c696b1 ResponseDesc=Internal Server Error 2021-07-13T00:10:54.061Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=3ba37999-9fad-41f5-924c-309ba934a667 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=6621 EndTimestamp=2021-07-13T00:10:54.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:47.439Z InvocationID=aa5a4529-fe8b-4d97-8282-42f32ad72b15 ResponseDesc=Internal Server Error 2021-07-13T00:10:54.065Z [qtp817348612-55] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=9bd5dea9-fe8d-4577-97ae-bfdfa1a1d89d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.065Z [qtp817348612-55] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9bd5dea9-fe8d-4577-97ae-bfdfa1a1d89d InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.065Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=9bd5dea9-fe8d-4577-97ae-bfdfa1a1d89d InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=17429 EndTimestamp=2021-07-13T00:10:54.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:36.636Z InvocationID=515e713b-f57f-4f44-b51b-b156a16d3fe4 ResponseDesc=Internal Server Error 2021-07-13T00:10:54.067Z [qtp817348612-47] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=bdb0235e-5907-488f-b578-1f368209bd05 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:10:54.067Z [qtp817348612-62] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=1dba79d7-5027-4544-b824-d189a8a878c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.067Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=bdb0235e-5907-488f-b578-1f368209bd05 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:10:54.067Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1dba79d7-5027-4544-b824-d189a8a878c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.067Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=bdb0235e-5907-488f-b578-1f368209bd05 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=4830 EndTimestamp=2021-07-13T00:10:54.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:49.237Z InvocationID=a93cecdc-b57c-4b4a-a83a-433193b14ab1 ResponseDesc=Internal Server Error 2021-07-13T00:10:54.069Z [qtp817348612-57] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=2c8c4f12-f124-4966-8eb7-09e0aff8acbe InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.069Z [qtp817348612-57] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=2c8c4f12-f124-4966-8eb7-09e0aff8acbe InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.069Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=2c8c4f12-f124-4966-8eb7-09e0aff8acbe InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=8006 EndTimestamp=2021-07-13T00:10:54.069Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:46.063Z InvocationID=18220784-95dd-4f37-b9eb-e0e9cc4c03f0 ResponseDesc=Internal Server Error 2021-07-13T00:10:54.070Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=1dba79d7-5027-4544-b824-d189a8a878c6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=672 EndTimestamp=2021-07-13T00:10:54.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:53.396Z InvocationID=7338ec16-af91-4f90-9b85-67f8af143f30 ResponseDesc=Internal Server Error 2021-07-13T00:10:54.070Z [qtp817348612-60] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=3749d2a3-252a-4378-825f-2b80161a5ca6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.070Z [qtp817348612-60] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3749d2a3-252a-4378-825f-2b80161a5ca6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.071Z [qtp817348612-60] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=3749d2a3-252a-4378-825f-2b80161a5ca6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=9165 EndTimestamp=2021-07-13T00:10:54.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:44.906Z InvocationID=8688a030-0235-4753-9292-95927d6b9e7d ResponseDesc=Internal Server Error 2021-07-13T00:10:54.073Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4b591259-fac1-47f2-b203-b2e5e2f5ea34 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:54.073Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:54.073Z InvocationID=de749954-bf21-4af3-9bca-846481cf35f9 2021-07-13T00:10:54.160Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4b591259-fac1-47f2-b203-b2e5e2f5ea34 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.165Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4b591259-fac1-47f2-b203-b2e5e2f5ea34 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.170Z [qtp817348612-11] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=4b591259-fac1-47f2-b203-b2e5e2f5ea34 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.170Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4b591259-fac1-47f2-b203-b2e5e2f5ea34 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:54.171Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=4b591259-fac1-47f2-b203-b2e5e2f5ea34 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=98 EndTimestamp=2021-07-13T00:10:54.171Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:54.073Z InvocationID=f8dc1b31-b328-400d-8478-e2e642efc3b0 ResponseDesc=Internal Server Error 2021-07-13T00:10:54.973Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d90d0089-e6b6-4bae-af0f-902b16b64545 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:54.973Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:54.973Z InvocationID=e1416c86-08f5-46e4-befa-ed131fe20162 2021-07-13T00:10:54.988Z [qtp817348612-53] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d90d0089-e6b6-4bae-af0f-902b16b64545 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:55.062Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d90d0089-e6b6-4bae-af0f-902b16b64545 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:55.067Z [qtp817348612-53] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=d90d0089-e6b6-4bae-af0f-902b16b64545 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:55.067Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d90d0089-e6b6-4bae-af0f-902b16b64545 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:55.068Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d90d0089-e6b6-4bae-af0f-902b16b64545 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=95 EndTimestamp=2021-07-13T00:10:55.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:54.973Z InvocationID=47e5b25a-ff28-4618-8452-d70f7a9ae3ed ResponseDesc=Internal Server Error 2021-07-13T00:10:55.667Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=70eb4e90-b3d6-453a-8ea0-8d4946838481 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:55.667Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:55.667Z InvocationID=f4d878ca-38b1-4db6-adc8-523be8d94a1a 2021-07-13T00:10:55.673Z [qtp817348612-62] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=70eb4e90-b3d6-453a-8ea0-8d4946838481 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:55.678Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=70eb4e90-b3d6-453a-8ea0-8d4946838481 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:55.761Z [qtp817348612-62] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=70eb4e90-b3d6-453a-8ea0-8d4946838481 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:55.762Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=70eb4e90-b3d6-453a-8ea0-8d4946838481 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:55.762Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=70eb4e90-b3d6-453a-8ea0-8d4946838481 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=95 EndTimestamp=2021-07-13T00:10:55.762Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:55.667Z InvocationID=d11f2ac8-3082-4f24-a680-474ddc63f2fd ResponseDesc=Internal Server Error 2021-07-13T00:10:56.562Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=29a69a21-a948-46af-8a52-aa58daf95167 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:56.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:56.562Z InvocationID=8d197ced-0c72-477b-a48e-aa8b535081b9 2021-07-13T00:10:56.571Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=29a69a21-a948-46af-8a52-aa58daf95167 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:56.577Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=29a69a21-a948-46af-8a52-aa58daf95167 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:56.660Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=29a69a21-a948-46af-8a52-aa58daf95167 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:56.660Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=29a69a21-a948-46af-8a52-aa58daf95167 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:56.660Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=29a69a21-a948-46af-8a52-aa58daf95167 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=98 EndTimestamp=2021-07-13T00:10:56.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:56.562Z InvocationID=69aa8330-4b04-49ce-a9b4-a34544799b84 ResponseDesc=Internal Server Error 2021-07-13T00:10:57.862Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=765066c2-4b24-47b8-a963-bef9dc6e3184 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:57.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:57.861Z InvocationID=50ab06ce-b2c5-4bd3-8e2b-b8a1e0eb08ad 2021-07-13T00:10:57.869Z [qtp817348612-18] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=765066c2-4b24-47b8-a963-bef9dc6e3184 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:57.962Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=765066c2-4b24-47b8-a963-bef9dc6e3184 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:57.967Z [qtp817348612-18] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=765066c2-4b24-47b8-a963-bef9dc6e3184 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:57.968Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=765066c2-4b24-47b8-a963-bef9dc6e3184 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:57.968Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=765066c2-4b24-47b8-a963-bef9dc6e3184 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=107 EndTimestamp=2021-07-13T00:10:57.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:57.861Z InvocationID=6884eab6-cc53-4773-b060-761ce74463a5 ResponseDesc=Internal Server Error 2021-07-13T00:10:58.865Z [qtp817348612-59] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b7a76206-9374-44ba-9daf-259d2eac9936 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:58.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:58.864Z InvocationID=5937a624-a27b-420e-8063-0c3526f2fe95 2021-07-13T00:10:58.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=65d55f99-5503-44b9-aac4-7f8ab9361bad InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:10:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:58.873Z InvocationID=a5e8f95b-05b8-41c9-ba38-11838e74d1d3 2021-07-13T00:10:58.874Z [qtp817348612-59] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b7a76206-9374-44ba-9daf-259d2eac9936 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:58.962Z [qtp817348612-59] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b7a76206-9374-44ba-9daf-259d2eac9936 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:58.964Z [qtp817348612-13] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=65d55f99-5503-44b9-aac4-7f8ab9361bad InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:58.967Z [qtp817348612-59] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=b7a76206-9374-44ba-9daf-259d2eac9936 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:58.967Z [qtp817348612-59] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b7a76206-9374-44ba-9daf-259d2eac9936 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:58.967Z [qtp817348612-59] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=b7a76206-9374-44ba-9daf-259d2eac9936 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=103 EndTimestamp=2021-07-13T00:10:58.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:58.864Z InvocationID=cfb7235f-6308-4731-b95e-e68e5537765d ResponseDesc=Internal Server Error 2021-07-13T00:10:58.971Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=65d55f99-5503-44b9-aac4-7f8ab9361bad InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:59.062Z [qtp817348612-13] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=65d55f99-5503-44b9-aac4-7f8ab9361bad InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:59.062Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=65d55f99-5503-44b9-aac4-7f8ab9361bad InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:10:59.062Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=65d55f99-5503-44b9-aac4-7f8ab9361bad InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=189 EndTimestamp=2021-07-13T00:10:59.062Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:10:58.873Z InvocationID=49fb1741-2f60-4f74-9f87-d7a9dfab398d ResponseDesc=Internal Server Error 2021-07-13T00:11:00.272Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=87835611-6fcf-4193-8a3c-280d8fa73f69 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:00.272Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:00.272Z InvocationID=d0fa1bbb-71fc-4565-8890-2087285de710 2021-07-13T00:11:00.364Z [qtp817348612-57] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=87835611-6fcf-4193-8a3c-280d8fa73f69 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:00.369Z [qtp817348612-57] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=87835611-6fcf-4193-8a3c-280d8fa73f69 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:00.374Z [qtp817348612-57] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=87835611-6fcf-4193-8a3c-280d8fa73f69 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:00.374Z [qtp817348612-57] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=87835611-6fcf-4193-8a3c-280d8fa73f69 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:00.375Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=87835611-6fcf-4193-8a3c-280d8fa73f69 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=103 EndTimestamp=2021-07-13T00:11:00.375Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:00.272Z InvocationID=068c8da3-fb5d-4897-b413-48d468b2e325 ResponseDesc=Internal Server Error 2021-07-13T00:11:01.370Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d7e4d27a-c1a4-4da0-bd30-e8942c787d7e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:01.369Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:01.369Z InvocationID=c34dc6a1-fb29-4f71-b6fa-087dcee82edf 2021-07-13T00:11:01.464Z [qtp817348612-56] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d7e4d27a-c1a4-4da0-bd30-e8942c787d7e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:01.473Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d7e4d27a-c1a4-4da0-bd30-e8942c787d7e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:01.560Z [qtp817348612-56] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=d7e4d27a-c1a4-4da0-bd30-e8942c787d7e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:01.560Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d7e4d27a-c1a4-4da0-bd30-e8942c787d7e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:01.561Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d7e4d27a-c1a4-4da0-bd30-e8942c787d7e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=192 EndTimestamp=2021-07-13T00:11:01.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:01.369Z InvocationID=6b83594c-5107-49ac-a658-4868991ec628 ResponseDesc=Internal Server Error 2021-07-13T00:11:02.760Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7ac8be14-b33d-4f83-8fd5-c0bb225db0f6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:02.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:02.760Z InvocationID=9b78d322-9a12-422d-a69f-9a8a63cf3cc8 2021-07-13T00:11:02.770Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7ac8be14-b33d-4f83-8fd5-c0bb225db0f6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:02.860Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7ac8be14-b33d-4f83-8fd5-c0bb225db0f6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:02.868Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=7ac8be14-b33d-4f83-8fd5-c0bb225db0f6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:02.868Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7ac8be14-b33d-4f83-8fd5-c0bb225db0f6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:02.868Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=7ac8be14-b33d-4f83-8fd5-c0bb225db0f6 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=108 EndTimestamp=2021-07-13T00:11:02.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:02.760Z InvocationID=76225139-029e-4f3f-a6c9-6dff5590e3fe ResponseDesc=Internal Server Error 2021-07-13T00:11:03.862Z [qtp817348612-58] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=abefa9fb-a9ce-4415-93eb-5106a0bc684f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:03.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:03.862Z InvocationID=86090b14-f357-4cdd-ba95-a47e0bde156b 2021-07-13T00:11:03.867Z [qtp817348612-58] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=abefa9fb-a9ce-4415-93eb-5106a0bc684f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:03.964Z [qtp817348612-58] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=abefa9fb-a9ce-4415-93eb-5106a0bc684f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:03.971Z [qtp817348612-58] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=abefa9fb-a9ce-4415-93eb-5106a0bc684f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:03.971Z [qtp817348612-58] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=abefa9fb-a9ce-4415-93eb-5106a0bc684f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:03.971Z [qtp817348612-58] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=abefa9fb-a9ce-4415-93eb-5106a0bc684f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=109 EndTimestamp=2021-07-13T00:11:03.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:03.862Z InvocationID=1a5ec816-10df-4ec2-b4a3-9489273704c6 ResponseDesc=Internal Server Error 2021-07-13T00:11:05.861Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=04e42401-52cf-41bf-ae88-0b1e76cbd4fa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:05.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:05.861Z InvocationID=52f37814-f267-41d6-a697-484a1eed15a2 2021-07-13T00:11:05.966Z [qtp817348612-47] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=04e42401-52cf-41bf-ae88-0b1e76cbd4fa InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:05.971Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=04e42401-52cf-41bf-ae88-0b1e76cbd4fa InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:06.060Z [qtp817348612-47] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=04e42401-52cf-41bf-ae88-0b1e76cbd4fa InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:06.060Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=04e42401-52cf-41bf-ae88-0b1e76cbd4fa InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:06.061Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=04e42401-52cf-41bf-ae88-0b1e76cbd4fa InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=200 EndTimestamp=2021-07-13T00:11:06.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:05.861Z InvocationID=46f8b85d-68f3-48a7-ad7c-9bc3302230af ResponseDesc=Internal Server Error 2021-07-13T00:11:08.570Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cd8dbd61-8efe-4ddd-b227-2f9b83eb627e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:08.570Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:08.570Z InvocationID=8d305c12-f6ea-44b8-8859-da37869cff7d 2021-07-13T00:11:08.660Z [qtp817348612-55] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cd8dbd61-8efe-4ddd-b227-2f9b83eb627e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:08.665Z [qtp817348612-55] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=cd8dbd61-8efe-4ddd-b227-2f9b83eb627e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:08.669Z [qtp817348612-55] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=cd8dbd61-8efe-4ddd-b227-2f9b83eb627e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:08.669Z [qtp817348612-55] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=cd8dbd61-8efe-4ddd-b227-2f9b83eb627e InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:08.670Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=cd8dbd61-8efe-4ddd-b227-2f9b83eb627e InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=100 EndTimestamp=2021-07-13T00:11:08.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:08.570Z InvocationID=5495feae-d04c-4a05-b238-b3036ac77ee6 ResponseDesc=Internal Server Error 2021-07-13T00:11:08.873Z [qtp817348612-61] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1b540781-2155-4948-9f24-4e7413e3b561 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=621bc774-7070-4568-a281-519f883a1e83 EntryTimestamp=2021-07-13T00:11:08.873Z ElapsedTime=0 EndTimestamp=2021-07-13T00:11:08.873Z InvocationID=7f33448e-2666-4ed0-95f3-17ed3105e033 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:11:08.960Z [qtp817348612-61] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1b540781-2155-4948-9f24-4e7413e3b561 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:09.068Z [qtp817348612-61] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1b540781-2155-4948-9f24-4e7413e3b561 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:09.157Z [qtp817348612-61] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=1b540781-2155-4948-9f24-4e7413e3b561 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:09.157Z [qtp817348612-61] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1b540781-2155-4948-9f24-4e7413e3b561 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:09.158Z [qtp817348612-61] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=1b540781-2155-4948-9f24-4e7413e3b561 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=285 EndTimestamp=2021-07-13T00:11:09.158Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:08.873Z InvocationID=3d028cb4-1389-4eba-ba99-d23d4be711e6 ResponseDesc=Internal Server Error 2021-07-13T00:11:11.764Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d9efff7c-79fb-45cf-91ed-4e2a61dc1898 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:11.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:11.764Z InvocationID=a9b72a85-09b9-4895-837e-d3332827037b 2021-07-13T00:11:11.857Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d9efff7c-79fb-45cf-91ed-4e2a61dc1898 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:11.867Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d9efff7c-79fb-45cf-91ed-4e2a61dc1898 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:11.870Z [qtp817348612-11] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=d9efff7c-79fb-45cf-91ed-4e2a61dc1898 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:11.871Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d9efff7c-79fb-45cf-91ed-4e2a61dc1898 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:11.871Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d9efff7c-79fb-45cf-91ed-4e2a61dc1898 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=107 EndTimestamp=2021-07-13T00:11:11.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:11.764Z InvocationID=b361b909-55f9-4891-85f3-a43a3c03598b ResponseDesc=Internal Server Error 2021-07-13T00:11:14.474Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=51877a28-ad94-420f-9868-b1f3a1080593 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:14.474Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:14.474Z InvocationID=949bd482-35dd-4153-a917-a356ae1de593 2021-07-13T00:11:14.560Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=51877a28-ad94-420f-9868-b1f3a1080593 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:14.564Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=51877a28-ad94-420f-9868-b1f3a1080593 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:14.567Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=51877a28-ad94-420f-9868-b1f3a1080593 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:14.567Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=51877a28-ad94-420f-9868-b1f3a1080593 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:14.568Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=51877a28-ad94-420f-9868-b1f3a1080593 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=94 EndTimestamp=2021-07-13T00:11:14.568Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:14.474Z InvocationID=6eaf8c0f-4761-48d9-ade1-f358eecf7378 ResponseDesc=Internal Server Error 2021-07-13T00:11:17.872Z [qtp817348612-60] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=24290401-bbb8-4c04-b346-bbc989dfb6a2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:17.872Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:17.872Z InvocationID=183f9266-770c-4518-b71e-e8f6ded58b24 2021-07-13T00:11:17.960Z [qtp817348612-60] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=24290401-bbb8-4c04-b346-bbc989dfb6a2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:17.970Z [qtp817348612-60] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=24290401-bbb8-4c04-b346-bbc989dfb6a2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:17.974Z [qtp817348612-60] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=24290401-bbb8-4c04-b346-bbc989dfb6a2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:17.974Z [qtp817348612-60] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=24290401-bbb8-4c04-b346-bbc989dfb6a2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:17.974Z [qtp817348612-60] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=24290401-bbb8-4c04-b346-bbc989dfb6a2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=102 EndTimestamp=2021-07-13T00:11:17.974Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:17.872Z InvocationID=b0f31b5b-e657-4ff3-901b-62455cedb02b ResponseDesc=Internal Server Error 2021-07-13T00:11:18.872Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1c767364-2e80-44db-b85a-e09c1b8bcfa2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:18.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:18.872Z InvocationID=86c40efc-e449-4ddd-b19a-27181e9d8e14 2021-07-13T00:11:18.960Z [qtp817348612-53] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1c767364-2e80-44db-b85a-e09c1b8bcfa2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:18.967Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1c767364-2e80-44db-b85a-e09c1b8bcfa2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:19.067Z [qtp817348612-53] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=1c767364-2e80-44db-b85a-e09c1b8bcfa2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:19.067Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1c767364-2e80-44db-b85a-e09c1b8bcfa2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:19.067Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=1c767364-2e80-44db-b85a-e09c1b8bcfa2 InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=195 EndTimestamp=2021-07-13T00:11:19.067Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:18.872Z InvocationID=25eedbbe-f0a0-4f15-b993-15ea27aba091 ResponseDesc=Internal Server Error 2021-07-13T00:11:20.869Z [qtp817348612-59] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=662edfb2-c6d7-43ac-8245-9b93875e467f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:20.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:20.869Z InvocationID=8b41a4af-3c5d-47ad-b16e-50d3e88d49b3 2021-07-13T00:11:20.958Z [qtp817348612-59] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=662edfb2-c6d7-43ac-8245-9b93875e467f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:20.962Z [qtp817348612-59] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=662edfb2-c6d7-43ac-8245-9b93875e467f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:21.060Z [qtp817348612-59] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=662edfb2-c6d7-43ac-8245-9b93875e467f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:21.060Z [qtp817348612-59] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=662edfb2-c6d7-43ac-8245-9b93875e467f InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:21.060Z [qtp817348612-59] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=662edfb2-c6d7-43ac-8245-9b93875e467f InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=191 EndTimestamp=2021-07-13T00:11:21.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:20.869Z InvocationID=39bf4d75-58eb-42e7-842d-a20d943cdfe9 ResponseDesc=Internal Server Error 2021-07-13T00:11:23.763Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=443d9f6e-5fe9-4775-b4b3-0d5560a06c8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=0 EndTimestamp=2021-07-13T00:11:23.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:23.763Z InvocationID=c16b5130-1e1e-48c4-8110-e759394338dd 2021-07-13T00:11:23.882Z [qtp817348612-56] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=443d9f6e-5fe9-4775-b4b3-0d5560a06c8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:23.886Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=443d9f6e-5fe9-4775-b4b3-0d5560a06c8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:23.890Z [qtp817348612-56] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=443d9f6e-5fe9-4775-b4b3-0d5560a06c8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:23.890Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=443d9f6e-5fe9-4775-b4b3-0d5560a06c8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:11:23.890Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=443d9f6e-5fe9-4775-b4b3-0d5560a06c8a InstanceID=621bc774-7070-4568-a281-519f883a1e83 ElapsedTime=127 EndTimestamp=2021-07-13T00:11:23.890Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:11:23.763Z InvocationID=eaa223ae-6bea-45fd-a855-c8b8c0160974 ResponseDesc=Internal Server Error 2021-07-13T00:11:41.157Z [main] INFO o.s.web.context.ContextLoader Root WebApplicationContext: initialization started 2021-07-13T00:11:42.021Z [main] INFO o.h.validator.internal.util.Version HV000001: Hibernate Validator 5.3.6.Final 2021-07-13T00:11:42.314Z [main] INFO com.datastax.driver.core DataStax Java driver 3.8.0 for Apache Cassandra 2021-07-13T00:11:42.321Z [main] INFO c.d.driver.core.GuavaCompatibility Detected Guava >= 19 in the classpath, using modern compatibility layer 2021-07-13T00:11:42.336Z [main] INFO o.o.c.n.i.c.CassandraSessionFactory localDatacenter was provided, setting Cassndra client to use datacenter: Pod as local. 2021-07-13T00:11:42.344Z [main] INFO c.d.driver.core.SystemProperties com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false 2021-07-13T00:11:42.344Z [main] INFO c.datastax.driver.core.ClockFactory Using java.lang.System clock to generate timestamps. 2021-07-13T00:11:42.426Z [main] INFO o.o.c.n.i.c.CassandraSessionFactory Cassandra client created hosts: [cassandra.onap] port: 9042 SSL enabled: false reconnectTimeout 2021-07-13T00:11:42.495Z [main] INFO com.datastax.driver.core.NettyUtil Did not find Netty's native epoll transport in the classpath, defaulting to NIO. 2021-07-13T00:11:56.098Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-07-13T00:11:56.100Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.219.208:9042 added 2021-07-13T00:11:56.100Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.199.132:9042 added 2021-07-13T00:11:56.100Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.211.142:9042 added 2021-07-13T00:11:58.579Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T00:11:58.730Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T00:11:58.776Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T00:11:58.779Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.user_candidate_version <-> org.openecomp.sdc.versioning.dao.types.UserCandidateVersion] because it collides with previously registered codec MappedUDTCodec [dox.user_candidate_version <-> org.openecomp.sdc.versioning.dao.types.UserCandidateVersion] 2021-07-13T00:11:59.814Z [main] INFO o.o.c.e.i.ExternalTestingManagerImpl loaded external testing config {"client":{"enabled":true},"endpoints":["vtp,VTP,true,http://refrepo:8702/onapapi/vnfsdk-marketplace,onap.*","repository,Repository,false,,.*"]} 2021-07-13T00:11:59.819Z [main] INFO o.o.c.e.i.ExternalTestingManagerImpl processed external testing config [{"enabled":true,"title":"VTP","url":"http://refrepo:8702/onapapi/vnfsdk-marketplace","id":"vtp","apiKey":null,"scenarioFilter":"onap.*"},{"enabled":false,"title":"Repository","url":"","id":"repository","apiKey":null,"scenarioFilter":".*"}] 2021-07-13T00:12:00.771Z [main] INFO org.apache.cxf.endpoint.ServerImpl Setting the server's publish address to be / 2021-07-13T00:12:00.881Z [main] INFO o.s.web.context.ContextLoader Root WebApplicationContext initialized in 19722 ms 2021-07-13T00:12:03.179Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T00:12:03.290Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T00:12:03.310Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T00:12:03.663Z [main] INFO o.s.web.servlet.DispatcherServlet Initializing Servlet 'spring-mapper' 2021-07-13T00:12:03.850Z [main] INFO o.s.web.servlet.DispatcherServlet Completed initialization in 187 ms 2021-07-13T00:12:04.101Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=14f05519-d1b4-48f6-9bc5-5169830e8835 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:04.093Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:04.093Z InvocationID=e93f2ea6-4a6c-4937-ab39-26c840d0d77c PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:04.101Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d7fa6045-ec96-4bd1-b4b7-4b448d05b3f5 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:04.094Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:04.094Z InvocationID=1fa7c4e0-9c6c-4ca7-a2f9-572ce3dbdb19 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:04.422Z [qtp817348612-20] INFO c.d.driver.core.SystemProperties RequestID=d7fa6045-ec96-4bd1-b4b7-4b448d05b3f5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false 2021-07-13T00:12:04.422Z [qtp817348612-20] INFO c.datastax.driver.core.ClockFactory RequestID=d7fa6045-ec96-4bd1-b4b7-4b448d05b3f5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Using java.lang.System clock to generate timestamps. 2021-07-13T00:12:06.796Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=95847121-e82e-48f3-896c-68854cf80b4e ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:06.796Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:06.796Z InvocationID=8364db2b-74b9-4e3b-84a9-f5ec76f0ff03 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:11.191Z [qtp817348612-20] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=d7fa6045-ec96-4bd1-b4b7-4b448d05b3f5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-07-13T00:12:11.192Z [qtp817348612-20] INFO com.datastax.driver.core.Cluster RequestID=d7fa6045-ec96-4bd1-b4b7-4b448d05b3f5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.219.208:9042 added 2021-07-13T00:12:11.192Z [qtp817348612-20] INFO com.datastax.driver.core.Cluster RequestID=d7fa6045-ec96-4bd1-b4b7-4b448d05b3f5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.199.132:9042 added 2021-07-13T00:12:11.192Z [qtp817348612-20] INFO com.datastax.driver.core.Cluster RequestID=d7fa6045-ec96-4bd1-b4b7-4b448d05b3f5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.211.142:9042 added 2021-07-13T00:12:12.332Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81293131-ad75-4301-9a26-73733d0a4b9b ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:12.331Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:12.331Z InvocationID=615313bc-a915-49fe-a4bd-f02a880d684a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:12.804Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=76644853-3618-4c4c-9a35-43a9afe28005 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:12.804Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:12.804Z InvocationID=fc247ef3-08ce-4edd-aa7a-d94f87d1c4bb PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:15.620Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=14f05519-d1b4-48f6-9bc5-5169830e8835 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:16.033Z [qtp817348612-46] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=95847121-e82e-48f3-896c-68854cf80b4e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:12:16.057Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d7fa6045-ec96-4bd1-b4b7-4b448d05b3f5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:12:16.321Z [qtp817348612-55] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=76644853-3618-4c4c-9a35-43a9afe28005 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:12:16.359Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81293131-ad75-4301-9a26-73733d0a4b9b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:12:17.281Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d7fa6045-ec96-4bd1-b4b7-4b448d05b3f5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=13185 EndTimestamp=2021-07-13T00:12:17.279Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:04.094Z InvocationID=f252a36a-35d6-479a-bd25-ec31ac0f6f28 ResponseDesc=Internal Server Error 2021-07-13T00:12:17.359Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=95847121-e82e-48f3-896c-68854cf80b4e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=10563 EndTimestamp=2021-07-13T00:12:17.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:06.796Z InvocationID=69d31853-f9eb-4c21-a28a-6f7407ac6765 ResponseDesc=Internal Server Error 2021-07-13T00:12:17.416Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=14f05519-d1b4-48f6-9bc5-5169830e8835 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=13323 EndTimestamp=2021-07-13T00:12:17.416Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:04.093Z InvocationID=784b0e95-ab1a-473b-848b-613322fa52cf ResponseDesc=OK 2021-07-13T00:12:17.619Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=76644853-3618-4c4c-9a35-43a9afe28005 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=4814 EndTimestamp=2021-07-13T00:12:17.618Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:12.804Z InvocationID=0013a955-04c5-4cda-9ada-23dccf232c58 ResponseDesc=Internal Server Error 2021-07-13T00:12:17.660Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=81293131-ad75-4301-9a26-73733d0a4b9b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=5329 EndTimestamp=2021-07-13T00:12:17.660Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:12.331Z InvocationID=b0afdb11-6c7d-4984-a34b-dccce9a0d5be ResponseDesc=Internal Server Error 2021-07-13T00:12:18.672Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c6b69ad4-a76a-4022-8e58-487f1539f787 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:18.671Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:18.671Z InvocationID=70865a0a-5d1f-4949-8e14-d069a070c860 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:18.867Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c6b69ad4-a76a-4022-8e58-487f1539f787 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:19.159Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c6b69ad4-a76a-4022-8e58-487f1539f787 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=487 EndTimestamp=2021-07-13T00:12:19.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:18.671Z InvocationID=febf168b-4a3d-4274-80db-bc351abcdd7a ResponseDesc=OK 2021-07-13T00:12:20.672Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=02e2c466-6c0b-48d4-b3d3-d22887d0d601 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:20.671Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:20.671Z InvocationID=01eb3eee-31e6-4f3d-8545-50084147e85a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:20.916Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=02e2c466-6c0b-48d4-b3d3-d22887d0d601 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:21.316Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=02e2c466-6c0b-48d4-b3d3-d22887d0d601 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=645 EndTimestamp=2021-07-13T00:12:21.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:20.671Z InvocationID=b3cd014c-be8d-4412-b946-486982527281 ResponseDesc=OK 2021-07-13T00:12:22.335Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ba589dfa-6e05-4345-a8c9-e9944c8e5774 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:22.335Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:22.335Z InvocationID=3f6086e2-1037-424f-9560-58ed817e1d49 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:22.381Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a6665b43-7456-48ce-9617-03289dffc5a9 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:22.381Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:22.381Z InvocationID=9cdbeb35-2947-4b6f-b269-cdfe6d44679c PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:22.457Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ba589dfa-6e05-4345-a8c9-e9944c8e5774 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:22.915Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a6665b43-7456-48ce-9617-03289dffc5a9 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:22.966Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ba589dfa-6e05-4345-a8c9-e9944c8e5774 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=631 EndTimestamp=2021-07-13T00:12:22.966Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:22.335Z InvocationID=ad3d14a4-3312-44cb-ac68-3f3c104bde53 ResponseDesc=OK 2021-07-13T00:12:23.159Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a6665b43-7456-48ce-9617-03289dffc5a9 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=777 EndTimestamp=2021-07-13T00:12:23.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:22.381Z InvocationID=05dcae51-7cff-418d-a607-ba6b3b0a1d0a ResponseDesc=OK 2021-07-13T00:12:24.466Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a8d3e758-f75b-4c39-8e4b-e073a4d80eae ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:24.465Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:24.465Z InvocationID=5e040900-fe45-4005-842b-665cef90c137 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:24.689Z [qtp817348612-57] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a8d3e758-f75b-4c39-8e4b-e073a4d80eae InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:24.961Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a8d3e758-f75b-4c39-8e4b-e073a4d80eae InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=495 EndTimestamp=2021-07-13T00:12:24.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:24.465Z InvocationID=51b8d6a7-c650-4cca-98ab-f4d50099cd5e ResponseDesc=OK 2021-07-13T00:12:26.261Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=174df700-8c19-44ff-93a6-a0f6916eaff6 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:26.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:26.261Z InvocationID=54a287de-f57a-4344-bccf-b570c335ca20 2021-07-13T00:12:26.557Z [qtp817348612-46] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=174df700-8c19-44ff-93a6-a0f6916eaff6 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:26.962Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=174df700-8c19-44ff-93a6-a0f6916eaff6 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=700 EndTimestamp=2021-07-13T00:12:26.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:26.261Z InvocationID=f2947c4d-f5de-41c2-9de5-362b67f83dfa ResponseDesc=OK 2021-07-13T00:12:27.440Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bf3a05e1-09ea-4a94-94b9-4d3a791b8f33 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:27.439Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:27.439Z InvocationID=303bb453-722a-4862-8d16-53c8bbc1d87d PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:27.560Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bf3a05e1-09ea-4a94-94b9-4d3a791b8f33 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:27.858Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bf3a05e1-09ea-4a94-94b9-4d3a791b8f33 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=418 EndTimestamp=2021-07-13T00:12:27.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:27.439Z InvocationID=5b2935e6-aa4a-40eb-8773-be85e444ec02 ResponseDesc=OK 2021-07-13T00:12:28.264Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=847e185b-2c6c-4f78-ae1a-45ed7026bccf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:28.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:28.264Z InvocationID=a789e6d6-b44a-4e84-b003-225463118a1d 2021-07-13T00:12:28.876Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=577026bd-0a88-4393-8c49-ad4cf4911340 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:28.876Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:28.876Z InvocationID=d226d253-643a-4922-96bf-b5c5e0ba1116 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:29.460Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=577026bd-0a88-4393-8c49-ad4cf4911340 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:29.513Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=847e185b-2c6c-4f78-ae1a-45ed7026bccf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:29.983Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=577026bd-0a88-4393-8c49-ad4cf4911340 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=1106 EndTimestamp=2021-07-13T00:12:29.982Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:28.876Z InvocationID=956e86a3-3996-4271-a38b-16aaa6312249 ResponseDesc=OK 2021-07-13T00:12:30.075Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=847e185b-2c6c-4f78-ae1a-45ed7026bccf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=1811 EndTimestamp=2021-07-13T00:12:30.075Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:28.264Z InvocationID=3d8ef7d0-a8a6-4fef-95a8-e7e4c4106f58 ResponseDesc=OK 2021-07-13T00:12:31.074Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d55e79b0-d89a-43c0-a5d0-9f55030271e9 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:31.074Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:31.074Z InvocationID=bdabced8-f07c-404f-8075-7505d344a276 2021-07-13T00:12:31.360Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d55e79b0-d89a-43c0-a5d0-9f55030271e9 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:31.559Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d55e79b0-d89a-43c0-a5d0-9f55030271e9 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=485 EndTimestamp=2021-07-13T00:12:31.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:31.074Z InvocationID=efe2808d-4a8e-408e-a123-9d3a40cad73b ResponseDesc=OK 2021-07-13T00:12:32.668Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1fb1e1fe-c619-4246-bf40-67d968bf6295 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:32.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:32.668Z InvocationID=9c3c01d4-475a-4781-8652-947ee0220e57 2021-07-13T00:12:32.814Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1fb1e1fe-c619-4246-bf40-67d968bf6295 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:33.241Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1fb1e1fe-c619-4246-bf40-67d968bf6295 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=572 EndTimestamp=2021-07-13T00:12:33.240Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:32.668Z InvocationID=ffbd7c07-63f5-4374-ac23-4594614a1a37 ResponseDesc=OK 2021-07-13T00:12:34.819Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=23f3c6a2-2f28-4f1a-a0f5-6e00087c8618 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:34.818Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:34.818Z InvocationID=07388503-dcf8-4e13-80a4-23ccbff73e2e 2021-07-13T00:12:34.957Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=23f3c6a2-2f28-4f1a-a0f5-6e00087c8618 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:35.463Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=23f3c6a2-2f28-4f1a-a0f5-6e00087c8618 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=645 EndTimestamp=2021-07-13T00:12:35.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:34.818Z InvocationID=004eacf2-d982-4f2e-9078-39f586c5c367 ResponseDesc=OK 2021-07-13T00:12:36.365Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=38502601-b46b-40c4-9b21-1c769af874b1 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:36.365Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:36.365Z InvocationID=8f8e98ef-c7e6-4c2b-87a9-68482c5e5ec5 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:36.460Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=38502601-b46b-40c4-9b21-1c769af874b1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:36.658Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=38502601-b46b-40c4-9b21-1c769af874b1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=292 EndTimestamp=2021-07-13T00:12:36.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:36.365Z InvocationID=37cebf7f-924f-4a21-9f1c-0b61d2e4a80e ResponseDesc=OK 2021-07-13T00:12:37.440Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da1d2336-7a16-4af5-b253-95830aef1b19 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:37.440Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:37.440Z InvocationID=74059322-d5e6-4a3f-8521-1b6fbf589bed PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:38.112Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da1d2336-7a16-4af5-b253-95830aef1b19 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:38.163Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bd2d46b3-b7ba-4ef5-940e-590f85751d8b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:38.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:38.162Z InvocationID=56887e50-d0c2-4956-9b6c-63089c9096cb 2021-07-13T00:12:38.258Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bd2d46b3-b7ba-4ef5-940e-590f85751d8b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:38.716Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da1d2336-7a16-4af5-b253-95830aef1b19 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=1276 EndTimestamp=2021-07-13T00:12:38.716Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:37.440Z InvocationID=d1e20ab8-c479-48f7-9b6b-123f33c4680b ResponseDesc=OK 2021-07-13T00:12:38.860Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bd2d46b3-b7ba-4ef5-940e-590f85751d8b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=698 EndTimestamp=2021-07-13T00:12:38.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:38.162Z InvocationID=de8dc7db-de84-496f-9a1f-e1d52a8a57cc ResponseDesc=OK 2021-07-13T00:12:38.874Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f136f1af-524c-4f53-b180-04fc9a71f87b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:38.873Z InvocationID=46b45e77-051a-4a64-8fea-4a4c50b6c425 2021-07-13T00:12:38.960Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f136f1af-524c-4f53-b180-04fc9a71f87b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:39.163Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f136f1af-524c-4f53-b180-04fc9a71f87b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=290 EndTimestamp=2021-07-13T00:12:39.163Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:38.873Z InvocationID=d97a1279-a5e5-41c8-be73-7978b520187a ResponseDesc=OK 2021-07-13T00:12:40.166Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2948a20b-f0b9-433f-beb9-242a08f07e1e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:40.166Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:40.166Z InvocationID=ab8133df-1df3-4bed-b5bf-a9fef38fd1c1 2021-07-13T00:12:40.412Z [qtp817348612-46] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2948a20b-f0b9-433f-beb9-242a08f07e1e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:40.824Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2948a20b-f0b9-433f-beb9-242a08f07e1e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=658 EndTimestamp=2021-07-13T00:12:40.824Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:40.166Z InvocationID=f55c85aa-861c-41be-9577-ba696d863936 ResponseDesc=OK 2021-07-13T00:12:41.775Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f8179343-16cf-49cf-9853-e551c9006f84 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:41.775Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:41.775Z InvocationID=967f7a37-a683-470a-92d3-664156ffcfd5 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:41.962Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f8179343-16cf-49cf-9853-e551c9006f84 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:42.860Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f8179343-16cf-49cf-9853-e551c9006f84 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=1085 EndTimestamp=2021-07-13T00:12:42.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:41.775Z InvocationID=d41b1f60-fd28-4b88-a0bd-37414bf73db8 ResponseDesc=OK 2021-07-13T00:12:44.925Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c3571658-efd0-418a-9c70-e57304b044f2 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:12:44.925Z ElapsedTime=0 EndTimestamp=2021-07-13T00:12:44.925Z InvocationID=e4e8247f-c85f-4ccf-9441-853de56a7f94 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:12:45.161Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c3571658-efd0-418a-9c70-e57304b044f2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:12:45.358Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c3571658-efd0-418a-9c70-e57304b044f2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=433 EndTimestamp=2021-07-13T00:12:45.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:44.925Z InvocationID=7c77c847-e06b-41c8-82e5-fac5e4e061e1 ResponseDesc=OK 2021-07-13T00:12:46.463Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=15473cb8-0bb5-4422-87d3-052a835a79fb InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:46.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:46.463Z InvocationID=fd9546ff-5d24-4e85-af6c-3a75bbb59e1f 2021-07-13T00:12:47.442Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d3894b30-4c42-4e59-b3c3-e9322db1eeb2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:47.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:47.441Z InvocationID=f4459d7f-1492-4c23-9d87-fef809411297 2021-07-13T00:12:48.875Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=49abd33b-efba-498b-98d8-365dd0837251 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:12:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:48.874Z InvocationID=c7022971-b459-4d8f-9ae5-1ec363409f33 2021-07-13T00:12:57.464Z [qtp817348612-55] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d3894b30-4c42-4e59-b3c3-e9322db1eeb2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:12:58.535Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=15473cb8-0bb5-4422-87d3-052a835a79fb InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:12:58.962Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=49abd33b-efba-498b-98d8-365dd0837251 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:13:02.441Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1a001dc1-8af8-4d50-842a-cb1843f1eded InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:02.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:02.441Z InvocationID=42cc0a9c-f027-4b7e-bde5-b48b265eb5f9 2021-07-13T00:13:03.874Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cdf1b858-7c76-4065-b9eb-577acbc84cf4 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:03.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:03.874Z InvocationID=45ebf7c5-a09c-4fbb-be53-51ddb8a84149 2021-07-13T00:13:06.032Z [qtp817348612-57] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cdf1b858-7c76-4065-b9eb-577acbc84cf4 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:06.161Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=15473cb8-0bb5-4422-87d3-052a835a79fb InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=19697 EndTimestamp=2021-07-13T00:13:06.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:46.463Z InvocationID=99eb33c0-7e60-43e3-987a-34be10753409 ResponseDesc=Internal Server Error 2021-07-13T00:13:06.258Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cdf1b858-7c76-4065-b9eb-577acbc84cf4 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=2384 EndTimestamp=2021-07-13T00:13:06.258Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:03.874Z InvocationID=6a7b049c-9bde-4277-bd5e-2d937101f44b ResponseDesc=OK 2021-07-13T00:13:07.015Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1a001dc1-8af8-4d50-842a-cb1843f1eded InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:07.023Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=49abd33b-efba-498b-98d8-365dd0837251 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=18149 EndTimestamp=2021-07-13T00:13:07.023Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:48.874Z InvocationID=4f041ca2-5b16-4948-aaa4-5cbbcdfc423a ResponseDesc=Internal Server Error 2021-07-13T00:13:07.420Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d3894b30-4c42-4e59-b3c3-e9322db1eeb2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=19978 EndTimestamp=2021-07-13T00:13:07.419Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:12:47.441Z InvocationID=7b789a87-7a6a-47e1-bba3-82cfaf5e1896 ResponseDesc=Internal Server Error 2021-07-13T00:13:07.460Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1a001dc1-8af8-4d50-842a-cb1843f1eded InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=5019 EndTimestamp=2021-07-13T00:13:07.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:02.441Z InvocationID=2e6952c6-5d33-4cf1-9a35-3dbc8b45333d ResponseDesc=OK 2021-07-13T00:13:07.466Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ef7ea258-5b57-49af-972f-0400cf957a23 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:07.466Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:07.466Z InvocationID=453404bc-ecb6-48a9-9bba-4c8123adb930 2021-07-13T00:13:07.659Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ef7ea258-5b57-49af-972f-0400cf957a23 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:08.876Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7e307a65-3d1c-4e82-a631-ba26a54d14e1 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a EntryTimestamp=2021-07-13T00:13:08.875Z ElapsedTime=0 EndTimestamp=2021-07-13T00:13:08.875Z InvocationID=df6e131d-e6e7-4ef8-943a-73cdfb5b21dd PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:13:14.759Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ef7ea258-5b57-49af-972f-0400cf957a23 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=7292 EndTimestamp=2021-07-13T00:13:14.758Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:07.466Z InvocationID=194c31bb-d8a9-41ab-8c08-188aaa38ac58 ResponseDesc=OK 2021-07-13T00:13:16.917Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7e307a65-3d1c-4e82-a631-ba26a54d14e1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:16.979Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eade06c6-bc6c-4768-802f-319a96525734 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:16.979Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:16.979Z InvocationID=666a29a3-85fc-400f-a070-dc22f6638266 2021-07-13T00:13:17.157Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eade06c6-bc6c-4768-802f-319a96525734 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:17.447Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b01684a7-ce5d-44e0-a5bc-346f3ceb1512 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:17.446Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:17.446Z InvocationID=e1f59a74-8f5f-4dc2-b8d2-0e186417d3b7 2021-07-13T00:13:17.460Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eade06c6-bc6c-4768-802f-319a96525734 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=481 EndTimestamp=2021-07-13T00:13:17.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:16.979Z InvocationID=42d94478-f4eb-44ee-9c09-3684b92e26fd ResponseDesc=OK 2021-07-13T00:13:17.521Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7e307a65-3d1c-4e82-a631-ba26a54d14e1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=8646 EndTimestamp=2021-07-13T00:13:17.521Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:08.875Z InvocationID=18e56d37-a367-46c3-9232-71a236343c7d ResponseDesc=OK 2021-07-13T00:13:17.559Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b01684a7-ce5d-44e0-a5bc-346f3ceb1512 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:17.858Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b01684a7-ce5d-44e0-a5bc-346f3ceb1512 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=412 EndTimestamp=2021-07-13T00:13:17.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:17.446Z InvocationID=31f2cb13-9666-4506-9559-118fdb19b4e4 ResponseDesc=OK 2021-07-13T00:13:18.418Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=73e81df1-1d10-4270-b128-72e2fd175948 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:18.418Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:18.418Z InvocationID=28539454-8813-47a5-ae1b-000fd942a36f 2021-07-13T00:13:18.625Z [qtp817348612-46] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=73e81df1-1d10-4270-b128-72e2fd175948 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:18.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b533c6c4-7a79-4961-b263-14e479c2892c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:18.873Z InvocationID=29cb6615-c86d-4441-b34a-7a370dc08867 2021-07-13T00:13:19.063Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b533c6c4-7a79-4961-b263-14e479c2892c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:19.117Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=73e81df1-1d10-4270-b128-72e2fd175948 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=699 EndTimestamp=2021-07-13T00:13:19.117Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:18.418Z InvocationID=ee526a15-0d91-45d0-b3fb-eba6b5eb502e ResponseDesc=OK 2021-07-13T00:13:19.460Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b533c6c4-7a79-4961-b263-14e479c2892c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=587 EndTimestamp=2021-07-13T00:13:19.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:18.873Z InvocationID=4ea22212-d57f-4cb8-89a3-829a4188ab8b ResponseDesc=OK 2021-07-13T00:13:20.623Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=939d9e5e-ed39-4055-88e5-69b6c98f769f InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:20.623Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:20.623Z InvocationID=0fb30d44-3694-42c1-a628-cddf186c0f1a 2021-07-13T00:13:20.759Z [qtp817348612-55] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=939d9e5e-ed39-4055-88e5-69b6c98f769f InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:20.958Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=939d9e5e-ed39-4055-88e5-69b6c98f769f InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=335 EndTimestamp=2021-07-13T00:13:20.958Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:20.623Z InvocationID=b73ac95b-59fe-4b7d-b021-aea2df6d3857 ResponseDesc=OK 2021-07-13T00:13:22.084Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1e043309-a87e-4971-933a-3ab8b120d640 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:22.083Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:22.083Z InvocationID=2f09c498-407e-41f6-8422-380b375d423b 2021-07-13T00:13:23.231Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1e043309-a87e-4971-933a-3ab8b120d640 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:23.618Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1e043309-a87e-4971-933a-3ab8b120d640 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=1535 EndTimestamp=2021-07-13T00:13:23.618Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:22.083Z InvocationID=3e728370-ba1f-4eb1-be76-22d65d3a4ac0 ResponseDesc=OK 2021-07-13T00:13:26.419Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b7a4c13d-a0d1-4062-a4e8-aad10d7d4663 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:26.419Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:26.419Z InvocationID=bbdd8095-fc0a-4586-ac09-552f0cda30f8 2021-07-13T00:13:26.557Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b7a4c13d-a0d1-4062-a4e8-aad10d7d4663 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:26.861Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b7a4c13d-a0d1-4062-a4e8-aad10d7d4663 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=441 EndTimestamp=2021-07-13T00:13:26.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:26.419Z InvocationID=37816180-ed96-4a21-aef9-ec15e67b11ed ResponseDesc=OK 2021-07-13T00:13:27.439Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e547a49-281c-4540-bf92-5aec85232994 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:27.439Z InvocationID=52ff46ca-f243-428f-a737-a761b40ca3ad 2021-07-13T00:13:27.558Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e547a49-281c-4540-bf92-5aec85232994 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:27.858Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e547a49-281c-4540-bf92-5aec85232994 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=418 EndTimestamp=2021-07-13T00:13:27.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:27.439Z InvocationID=65f2c578-cb56-44a3-a245-fe4012b139ea ResponseDesc=OK 2021-07-13T00:13:28.069Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=adac7510-1eda-494e-a2c8-ef26ba892677 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:28.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:28.069Z InvocationID=5dc6b156-c48a-44e0-8a66-d352f4e96927 2021-07-13T00:13:28.316Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=adac7510-1eda-494e-a2c8-ef26ba892677 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:28.813Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=adac7510-1eda-494e-a2c8-ef26ba892677 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=743 EndTimestamp=2021-07-13T00:13:28.812Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:28.069Z InvocationID=f0523cec-d77e-4830-bf92-cc2f30a310c8 ResponseDesc=OK 2021-07-13T00:13:28.874Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=43ac07b7-ae7a-4f37-833b-045c1ee378ad InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:28.873Z InvocationID=8c2c6507-7317-42a7-819a-bbd716409960 2021-07-13T00:13:29.061Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=43ac07b7-ae7a-4f37-833b-045c1ee378ad InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:29.460Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=43ac07b7-ae7a-4f37-833b-045c1ee378ad InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=587 EndTimestamp=2021-07-13T00:13:29.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:28.873Z InvocationID=a72c4a7f-eb2f-4696-b5db-1c7410db70c2 ResponseDesc=OK 2021-07-13T00:13:30.019Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b3b98c8f-48e3-4aa0-aa5a-b27215fb22e5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:30.018Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:30.018Z InvocationID=350ee215-faa0-4253-a3e4-929a5b32988a 2021-07-13T00:13:30.160Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b3b98c8f-48e3-4aa0-aa5a-b27215fb22e5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:30.458Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b3b98c8f-48e3-4aa0-aa5a-b27215fb22e5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=440 EndTimestamp=2021-07-13T00:13:30.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:30.018Z InvocationID=d9766a7f-4723-4a7f-9d62-e7b0413b4f81 ResponseDesc=OK 2021-07-13T00:13:31.619Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=83d6cb3f-2f4c-476b-8db2-fd1c9011178e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:31.619Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:31.619Z InvocationID=b76b3cb0-03a8-4083-b15d-650765977a95 2021-07-13T00:13:31.911Z [qtp817348612-46] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=83d6cb3f-2f4c-476b-8db2-fd1c9011178e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:32.523Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=83d6cb3f-2f4c-476b-8db2-fd1c9011178e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=904 EndTimestamp=2021-07-13T00:13:32.523Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:31.619Z InvocationID=ce26e27d-891b-428c-a78e-5ac0e9ae4b84 ResponseDesc=OK 2021-07-13T00:13:35.132Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fde28330-c363-4c3c-ab8e-78b20ea94e63 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:35.132Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:35.132Z InvocationID=9433fd87-77fa-46f9-9a9a-acd866fa61a5 2021-07-13T00:13:35.257Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fde28330-c363-4c3c-ab8e-78b20ea94e63 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:35.661Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fde28330-c363-4c3c-ab8e-78b20ea94e63 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=528 EndTimestamp=2021-07-13T00:13:35.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:35.132Z InvocationID=2233b68b-bf3d-40db-b436-634dfd519c32 ResponseDesc=OK 2021-07-13T00:13:36.479Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dead8beb-87d3-4183-8614-c915166c24ff InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:36.478Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:36.478Z InvocationID=6e54b06c-1189-4d22-ab3c-23898e73ed62 2021-07-13T00:13:36.660Z [qtp817348612-57] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dead8beb-87d3-4183-8614-c915166c24ff InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:36.960Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dead8beb-87d3-4183-8614-c915166c24ff InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=481 EndTimestamp=2021-07-13T00:13:36.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:36.478Z InvocationID=1bbb987c-f550-4f8c-916d-b00c9e6cb74a ResponseDesc=OK 2021-07-13T00:13:37.443Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=042cc93d-279f-4441-a222-1fdfcf526763 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:37.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:37.443Z InvocationID=baead449-538a-4013-8b65-519237417eac 2021-07-13T00:13:37.718Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=042cc93d-279f-4441-a222-1fdfcf526763 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:38.118Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=042cc93d-279f-4441-a222-1fdfcf526763 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=675 EndTimestamp=2021-07-13T00:13:38.118Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:37.443Z InvocationID=d9b8f30e-f60d-4cb6-ae31-cd2c51d1d2e8 ResponseDesc=OK 2021-07-13T00:13:38.434Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aca218fa-c5b1-4f60-85e3-1dbd74cfea35 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:38.434Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:38.434Z InvocationID=9807b356-a09a-4597-beca-2beea9480de2 2021-07-13T00:13:38.557Z [qtp817348612-55] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aca218fa-c5b1-4f60-85e3-1dbd74cfea35 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:38.874Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=afb83f9b-76cc-4d6c-8697-79698957e02e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:38.874Z InvocationID=4d29b6ce-2692-42d2-a6a4-f4e53baba43a 2021-07-13T00:13:38.962Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aca218fa-c5b1-4f60-85e3-1dbd74cfea35 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=527 EndTimestamp=2021-07-13T00:13:38.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:38.434Z InvocationID=bc5df9a9-531d-4785-8535-bfa7e3787c25 ResponseDesc=OK 2021-07-13T00:13:39.062Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=afb83f9b-76cc-4d6c-8697-79698957e02e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:39.258Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=afb83f9b-76cc-4d6c-8697-79698957e02e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=384 EndTimestamp=2021-07-13T00:13:39.258Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:38.874Z InvocationID=24d67bd9-5c5e-401a-b2c1-ccf92dac9d70 ResponseDesc=OK 2021-07-13T00:13:40.320Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=16d01cdb-9467-495c-9ee8-c4396e3d85c4 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:40.320Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:40.320Z InvocationID=067e236b-9841-417b-a7fe-25464c3d05b0 2021-07-13T00:13:40.716Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=16d01cdb-9467-495c-9ee8-c4396e3d85c4 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:41.096Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=16d01cdb-9467-495c-9ee8-c4396e3d85c4 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=776 EndTimestamp=2021-07-13T00:13:41.096Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:40.320Z InvocationID=280238ad-85f7-4966-baec-ad8ec4929af0 ResponseDesc=OK 2021-07-13T00:13:47.441Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d2894a59-63ae-4c35-8638-f595d5ed3951 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:47.440Z InvocationID=afbb6756-ab77-4659-824c-eed6b134df4a 2021-07-13T00:13:48.875Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ebed3fe9-ecaa-4251-a9f0-28393f219e85 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:48.874Z InvocationID=b4f5e36b-4951-4b4c-b646-e48f0b013cb9 2021-07-13T00:13:51.730Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3fad60ab-fda2-468a-aea8-919c154d9687 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:51.730Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:51.730Z InvocationID=be0c3375-d0b9-47e8-a4ff-74c2aafa7c82 2021-07-13T00:13:51.757Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d2894a59-63ae-4c35-8638-f595d5ed3951 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:52.021Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d2894a59-63ae-4c35-8638-f595d5ed3951 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=4581 EndTimestamp=2021-07-13T00:13:52.021Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:47.440Z InvocationID=a8e212c4-8fb3-43ec-be79-d4e54a428e05 ResponseDesc=OK 2021-07-13T00:13:52.117Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3fad60ab-fda2-468a-aea8-919c154d9687 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:52.162Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ebed3fe9-ecaa-4251-a9f0-28393f219e85 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:13:52.557Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ebed3fe9-ecaa-4251-a9f0-28393f219e85 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=3683 EndTimestamp=2021-07-13T00:13:52.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:48.874Z InvocationID=ef23bdcc-15e9-43d8-bb06-9d98539c66bf ResponseDesc=OK 2021-07-13T00:13:55.113Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3fad60ab-fda2-468a-aea8-919c154d9687 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=3383 EndTimestamp=2021-07-13T00:13:55.113Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:51.730Z InvocationID=0c6190ea-bb25-4d73-8a6c-9f756b8dd599 ResponseDesc=OK 2021-07-13T00:13:55.824Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=02ab52c6-73f5-4d72-9227-cc74cc8a35b8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:55.823Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:55.823Z InvocationID=82600d30-3531-432b-b2df-197a0603ed8b 2021-07-13T00:13:57.450Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=63769545-5a38-4735-ba11-95125c89fc24 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:57.450Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:57.450Z InvocationID=564b7210-6398-4903-9551-c9afdf4dec29 2021-07-13T00:13:58.875Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d8c43197-155e-4732-9c40-26b19f8ace0f InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:58.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:58.875Z InvocationID=3536c3f7-d7ce-4c67-9ade-789b89590326 2021-07-13T00:13:59.912Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7540cc6a-6092-4ae6-8c15-d073c726f8e3 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:13:59.912Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:59.912Z InvocationID=1063dfad-93be-40d0-9aaa-56e2f6876c9e 2021-07-13T00:14:01.559Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d8c43197-155e-4732-9c40-26b19f8ace0f InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:01.658Z [qtp817348612-55] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=02ab52c6-73f5-4d72-9227-cc74cc8a35b8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:01.659Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7540cc6a-6092-4ae6-8c15-d073c726f8e3 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:01.726Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=63769545-5a38-4735-ba11-95125c89fc24 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:01.963Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d8c43197-155e-4732-9c40-26b19f8ace0f InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=3087 EndTimestamp=2021-07-13T00:14:01.962Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:58.875Z InvocationID=32387d35-c3cb-41ad-aee6-12d1641a7f8f ResponseDesc=OK 2021-07-13T00:14:02.059Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=02ab52c6-73f5-4d72-9227-cc74cc8a35b8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=6236 EndTimestamp=2021-07-13T00:14:02.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:55.823Z InvocationID=f236dfd6-d8b8-4dbd-9b53-acd7fd287118 ResponseDesc=OK 2021-07-13T00:14:02.360Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=63769545-5a38-4735-ba11-95125c89fc24 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=4910 EndTimestamp=2021-07-13T00:14:02.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:57.450Z InvocationID=84e32647-7d8c-419a-bcb2-108f6cb81fc9 ResponseDesc=OK 2021-07-13T00:14:03.118Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7540cc6a-6092-4ae6-8c15-d073c726f8e3 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=3205 EndTimestamp=2021-07-13T00:14:03.117Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:13:59.912Z InvocationID=5d93f1fe-fbab-49cf-8108-dcfd27ace6af ResponseDesc=OK 2021-07-13T00:14:04.863Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8e1ee9a9-d315-4523-a2f3-ded6571ff0d5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:04.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:04.863Z InvocationID=0706f873-7017-425f-abbb-9e35ea89c88f 2021-07-13T00:14:05.060Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8e1ee9a9-d315-4523-a2f3-ded6571ff0d5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:05.259Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8e1ee9a9-d315-4523-a2f3-ded6571ff0d5 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=396 EndTimestamp=2021-07-13T00:14:05.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:04.863Z InvocationID=18d86ddd-3bf4-4117-aba1-4aab43f29a90 ResponseDesc=OK 2021-07-13T00:14:06.973Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e69826ba-a54e-48e0-b183-ea5b207879f8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:06.973Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:06.973Z InvocationID=b0f4cbbc-ecca-492c-876b-9ff8e8076033 2021-07-13T00:14:07.440Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=572fe8c9-13ee-483d-a709-e61215825821 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:07.440Z InvocationID=857b4f0b-cfea-4537-a971-8a4a9706afbd 2021-07-13T00:14:08.161Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=572fe8c9-13ee-483d-a709-e61215825821 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:08.424Z [qtp817348612-57] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e69826ba-a54e-48e0-b183-ea5b207879f8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:08.875Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=421da701-2b1e-4e60-b509-83084e57ddc7 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:08.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:08.875Z InvocationID=c9501067-a846-4838-9f8e-4c534a9c2161 2021-07-13T00:14:09.126Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=572fe8c9-13ee-483d-a709-e61215825821 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=1686 EndTimestamp=2021-07-13T00:14:09.126Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:07.440Z InvocationID=6c5c0b90-484c-4b23-b4fb-d8ae7726c3b6 ResponseDesc=OK 2021-07-13T00:14:09.359Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=421da701-2b1e-4e60-b509-83084e57ddc7 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:09.361Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e69826ba-a54e-48e0-b183-ea5b207879f8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=2388 EndTimestamp=2021-07-13T00:14:09.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:06.973Z InvocationID=80c317c1-31dc-44ab-a288-f59a047a2fe4 ResponseDesc=OK 2021-07-13T00:14:09.558Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=421da701-2b1e-4e60-b509-83084e57ddc7 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=683 EndTimestamp=2021-07-13T00:14:09.558Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:08.875Z InvocationID=175d4cb4-d0a5-46de-b99d-deeb518b7aba ResponseDesc=OK 2021-07-13T00:14:10.737Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=64f43791-1f50-45f3-bb01-603cfbfcfde7 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:10.737Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:10.737Z InvocationID=1ddf4844-1d14-4a0a-8222-b58f4b412e45 2021-07-13T00:14:11.414Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=64f43791-1f50-45f3-bb01-603cfbfcfde7 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:11.716Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=64f43791-1f50-45f3-bb01-603cfbfcfde7 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=978 EndTimestamp=2021-07-13T00:14:11.715Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:10.737Z InvocationID=4065ff49-4f71-4ac6-8eaf-add71ee5a7a0 ResponseDesc=OK 2021-07-13T00:14:14.620Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9644bbf3-0f8a-4da4-a003-59f58baca8bf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:14.620Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:14.620Z InvocationID=3297202d-eaa9-4e8a-a411-3d0cad40d9c3 2021-07-13T00:14:14.768Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9644bbf3-0f8a-4da4-a003-59f58baca8bf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:15.160Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9644bbf3-0f8a-4da4-a003-59f58baca8bf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=540 EndTimestamp=2021-07-13T00:14:15.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:14.620Z InvocationID=18442e0c-8562-4278-9dd7-e8588a018d80 ResponseDesc=OK 2021-07-13T00:14:16.631Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=66e9c8eb-e57a-4fab-9152-b3f5792c4fab InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:16.631Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:16.631Z InvocationID=3ba01180-56f4-4346-97ee-915bb505c441 2021-07-13T00:14:16.759Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=66e9c8eb-e57a-4fab-9152-b3f5792c4fab InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:16.964Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=66e9c8eb-e57a-4fab-9152-b3f5792c4fab InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=333 EndTimestamp=2021-07-13T00:14:16.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:16.631Z InvocationID=f02baefa-a742-49a4-9e04-53c5e24ab927 ResponseDesc=OK 2021-07-13T00:14:17.442Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d0de56e-fd09-47c8-bee3-5bbb9a48f92c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:17.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:17.442Z InvocationID=951b625f-8e94-4376-a424-ed701d1decb2 2021-07-13T00:14:18.876Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8e4a12cd-02c8-4e12-811a-925224a68735 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:18.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:18.876Z InvocationID=c4231c40-4386-437d-ab08-53f25ae6a0eb 2021-07-13T00:14:22.059Z [qtp817348612-46] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8e4a12cd-02c8-4e12-811a-925224a68735 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:22.122Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7fdb4d23-8c8b-4389-b213-a0411dc3ab61 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:22.122Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:22.122Z InvocationID=f55ce8e6-16d3-4020-8ff0-a3216c2a8b87 2021-07-13T00:14:22.318Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d0de56e-fd09-47c8-bee3-5bbb9a48f92c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:14:29.161Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2d0de56e-fd09-47c8-bee3-5bbb9a48f92c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=11719 EndTimestamp=2021-07-13T00:14:29.161Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:17.442Z InvocationID=384dcb6e-a605-4b79-b987-7af159b0afaa ResponseDesc=OK 2021-07-13T00:14:29.168Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=68b41e65-31da-4b05-a978-816016f3af82 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:29.168Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:29.168Z InvocationID=bfdba78f-005d-4d4b-97a7-768f7b409a1a 2021-07-13T00:14:33.874Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3cb418f4-e235-413c-87a5-cf55649315d2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:33.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:33.873Z InvocationID=a82a7741-3f94-4f21-979a-b0ac8d15fa30 2021-07-13T00:14:34.138Z [qtp817348612-44] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7fdb4d23-8c8b-4389-b213-a0411dc3ab61 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:14:34.338Z [qtp817348612-46] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=8e4a12cd-02c8-4e12-811a-925224a68735 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:14:34.338Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=8e4a12cd-02c8-4e12-811a-925224a68735 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:14:34.339Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=8e4a12cd-02c8-4e12-811a-925224a68735 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=15463 EndTimestamp=2021-07-13T00:14:34.339Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:18.876Z InvocationID=c4c3309e-d0ad-4b31-9bbe-8a6d31cb868d ResponseDesc=Internal Server Error 2021-07-13T00:14:39.175Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=68b41e65-31da-4b05-a978-816016f3af82 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:14:44.144Z [qtp817348612-44] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7fdb4d23-8c8b-4389-b213-a0411dc3ab61 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:14:44.169Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cf2655eb-213b-44e2-b22d-528c0755fcea InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:44.169Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:44.169Z InvocationID=78d5045e-b3ff-4237-91ac-53bca45b7678 2021-07-13T00:14:45.240Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0a536ed1-ac94-494f-aace-cb4478530fd1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:45.240Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:45.240Z InvocationID=628b9a38-577f-428f-8e92-0a10b16c4d55 2021-07-13T00:14:45.265Z [qtp817348612-14] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0a536ed1-ac94-494f-aace-cb4478530fd1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:14:45.936Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3cb418f4-e235-413c-87a5-cf55649315d2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:14:48.876Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=058a8ad8-4e67-4941-9a10-b89af6929367 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:48.875Z InvocationID=335a3a3b-ef70-4e00-b63b-688fe90c31da 2021-07-13T00:14:48.961Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=058a8ad8-4e67-4941-9a10-b89af6929367 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:14:49.259Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=68b41e65-31da-4b05-a978-816016f3af82 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:14:49.277Z [qtp817348612-17] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=68b41e65-31da-4b05-a978-816016f3af82 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:14:49.277Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=68b41e65-31da-4b05-a978-816016f3af82 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:14:49.279Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=68b41e65-31da-4b05-a978-816016f3af82 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=20110 EndTimestamp=2021-07-13T00:14:49.278Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:29.168Z InvocationID=c0723939-df5f-4554-8ebe-90f6122c04e4 ResponseDesc=Internal Server Error 2021-07-13T00:14:49.308Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b48bace7-a87c-4f29-93e0-f35d0d5860fa InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:49.308Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:49.308Z InvocationID=636d9438-1688-4a99-a19a-cc339718ca4c 2021-07-13T00:14:53.205Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d9f1c82-5fe2-4df0-923f-69945bed5a6b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:53.205Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:53.205Z InvocationID=f74a12cb-2edf-41ce-bd05-6300363673be 2021-07-13T00:14:53.271Z [qtp817348612-46] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d9f1c82-5fe2-4df0-923f-69945bed5a6b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:14:56.231Z [qtp817348612-44] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=7fdb4d23-8c8b-4389-b213-a0411dc3ab61 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:14:56.232Z [qtp817348612-44] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7fdb4d23-8c8b-4389-b213-a0411dc3ab61 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:14:56.232Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=7fdb4d23-8c8b-4389-b213-a0411dc3ab61 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=34110 EndTimestamp=2021-07-13T00:14:56.232Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:22.122Z InvocationID=90b8e83f-f2f5-488c-a370-3fed800482c9 ResponseDesc=Internal Server Error 2021-07-13T00:14:56.235Z [qtp817348612-53] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cf2655eb-213b-44e2-b22d-528c0755fcea InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:14:57.336Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0a536ed1-ac94-494f-aace-cb4478530fd1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:14:57.407Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=49785ae8-0c97-4094-861b-13b02a52e26e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:57.407Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:57.407Z InvocationID=0294d0de-053d-4a4d-a04f-2974ea1a86d2 2021-07-13T00:14:57.465Z [qtp817348612-48] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=49785ae8-0c97-4094-861b-13b02a52e26e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:14:58.036Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3cb418f4-e235-413c-87a5-cf55649315d2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:14:59.169Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8ebd6ec7-5d52-46d2-8fc9-e8e89f2e6918 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:14:59.169Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:59.169Z InvocationID=17fb240f-5585-42c6-8239-8e182fccfbda 2021-07-13T00:15:01.112Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5ca227c2-2742-4680-984f-9d002275ed9d InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:01.111Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:01.111Z InvocationID=7ed8354d-0d7c-4b82-a956-279ed673d6fb 2021-07-13T00:15:01.135Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=058a8ad8-4e67-4941-9a10-b89af6929367 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:01.163Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=058a8ad8-4e67-4941-9a10-b89af6929367 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:01.163Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=058a8ad8-4e67-4941-9a10-b89af6929367 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:01.164Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=058a8ad8-4e67-4941-9a10-b89af6929367 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=12289 EndTimestamp=2021-07-13T00:15:01.164Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:48.875Z InvocationID=f4a2dd86-17b8-4c83-a48d-4ec88fb34807 ResponseDesc=Internal Server Error 2021-07-13T00:15:01.167Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5ca227c2-2742-4680-984f-9d002275ed9d InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:01.168Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ff11cd75-db2b-4297-ae54-7e78a54aa9be InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:01.168Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:01.168Z InvocationID=c576b30e-3fa7-4c86-b20c-edd4bd7c6431 2021-07-13T00:15:01.336Z [qtp817348612-13] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b48bace7-a87c-4f29-93e0-f35d0d5860fa InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:01.361Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b48bace7-a87c-4f29-93e0-f35d0d5860fa InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:05.336Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3d9f1c82-5fe2-4df0-923f-69945bed5a6b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:05.423Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=55490383-8ee2-4815-9da8-e44614f73104 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:05.423Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:05.423Z InvocationID=0ae0824a-54d0-40e2-89cc-276964c822c8 2021-07-13T00:15:08.336Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=cf2655eb-213b-44e2-b22d-528c0755fcea InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:08.364Z [qtp817348612-53] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=cf2655eb-213b-44e2-b22d-528c0755fcea InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:08.364Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=cf2655eb-213b-44e2-b22d-528c0755fcea InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:08.365Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=cf2655eb-213b-44e2-b22d-528c0755fcea InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=24196 EndTimestamp=2021-07-13T00:15:08.365Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:44.169Z InvocationID=5ca74b84-41ff-47b0-a2b5-df8561108a34 ResponseDesc=Internal Server Error 2021-07-13T00:15:09.406Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=09bed864-80d3-46e5-8876-3b62706ffdf8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:09.406Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:09.406Z InvocationID=05eb2963-bd77-46fe-a1b1-2612ad70501a 2021-07-13T00:15:09.432Z [qtp817348612-14] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=0a536ed1-ac94-494f-aace-cb4478530fd1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:09.432Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0a536ed1-ac94-494f-aace-cb4478530fd1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:09.433Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=0a536ed1-ac94-494f-aace-cb4478530fd1 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=24192 EndTimestamp=2021-07-13T00:15:09.432Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:45.240Z InvocationID=dcb3c7f2-d51f-4032-8d74-44305ee608aa ResponseDesc=Internal Server Error 2021-07-13T00:15:09.536Z [qtp817348612-48] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=49785ae8-0c97-4094-861b-13b02a52e26e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:10.132Z [qtp817348612-54] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=3cb418f4-e235-413c-87a5-cf55649315d2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:10.132Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3cb418f4-e235-413c-87a5-cf55649315d2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:10.133Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=3cb418f4-e235-413c-87a5-cf55649315d2 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=36260 EndTimestamp=2021-07-13T00:15:10.133Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:33.873Z InvocationID=e0394839-5d49-4d7f-b9ad-58e72be9532d ResponseDesc=Internal Server Error 2021-07-13T00:15:11.235Z [qtp817348612-57] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8ebd6ec7-5d52-46d2-8fc9-e8e89f2e6918 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:11.266Z [qtp817348612-57] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=8ebd6ec7-5d52-46d2-8fc9-e8e89f2e6918 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:13.236Z [qtp817348612-56] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ff11cd75-db2b-4297-ae54-7e78a54aa9be InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:13.236Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5ca227c2-2742-4680-984f-9d002275ed9d InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:13.365Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=5ca227c2-2742-4680-984f-9d002275ed9d InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:13.365Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5ca227c2-2742-4680-984f-9d002275ed9d InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:13.365Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=5ca227c2-2742-4680-984f-9d002275ed9d InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=12254 EndTimestamp=2021-07-13T00:15:13.365Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:01.111Z InvocationID=9699c379-6dd2-45b8-829b-5e87adafdf16 ResponseDesc=Internal Server Error 2021-07-13T00:15:13.413Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9abd4419-9900-43b7-a50e-5a162df5fb87 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:13.413Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:13.413Z InvocationID=91bf0d59-487d-4c3e-bc56-3df040dce044 2021-07-13T00:15:13.436Z [qtp817348612-13] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=b48bace7-a87c-4f29-93e0-f35d0d5860fa InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:13.436Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b48bace7-a87c-4f29-93e0-f35d0d5860fa InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:13.437Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=b48bace7-a87c-4f29-93e0-f35d0d5860fa InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=24129 EndTimestamp=2021-07-13T00:15:13.437Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:49.308Z InvocationID=b10a9d3e-3a98-4189-bfd3-faf21ccf327d ResponseDesc=Internal Server Error 2021-07-13T00:15:16.170Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0fe4bb8a-f486-418e-afdb-287400395772 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:16.170Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:16.170Z InvocationID=4d3c893b-a5b1-4deb-9c4e-b09fd44cdff2 2021-07-13T00:15:16.262Z [qtp817348612-44] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0fe4bb8a-f486-418e-afdb-287400395772 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:17.435Z [qtp817348612-46] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=3d9f1c82-5fe2-4df0-923f-69945bed5a6b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:17.435Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3d9f1c82-5fe2-4df0-923f-69945bed5a6b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:17.436Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=3d9f1c82-5fe2-4df0-923f-69945bed5a6b InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=24231 EndTimestamp=2021-07-13T00:15:17.436Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:53.205Z InvocationID=08517f7e-1811-42f6-98fb-931f01759d77 ResponseDesc=Internal Server Error 2021-07-13T00:15:17.513Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2577deb8-fff1-47cf-96ad-9418039c685e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:17.512Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:17.512Z InvocationID=9c2d3f1e-faf1-4393-a455-272bca94f577 2021-07-13T00:15:17.536Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=55490383-8ee2-4815-9da8-e44614f73104 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:17.564Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=55490383-8ee2-4815-9da8-e44614f73104 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.618Z [qtp817348612-53] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=09bed864-80d3-46e5-8876-3b62706ffdf8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.626Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ff11cd75-db2b-4297-ae54-7e78a54aa9be InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:19.628Z [qtp817348612-44] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0fe4bb8a-f486-418e-afdb-287400395772 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:19.662Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9abd4419-9900-43b7-a50e-5a162df5fb87 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:19.665Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2577deb8-fff1-47cf-96ad-9418039c685e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.666Z [qtp817348612-44] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=0fe4bb8a-f486-418e-afdb-287400395772 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.666Z [qtp817348612-44] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0fe4bb8a-f486-418e-afdb-287400395772 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.667Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=0fe4bb8a-f486-418e-afdb-287400395772 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=3497 EndTimestamp=2021-07-13T00:15:19.667Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:16.170Z InvocationID=0f1d239c-3b1a-42ef-a6c4-2b6bb4fdcbd1 ResponseDesc=Internal Server Error 2021-07-13T00:15:19.673Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=2577deb8-fff1-47cf-96ad-9418039c685e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.674Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=49434b87-5fb9-42e0-8fba-528238470959 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:19.673Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:19.673Z InvocationID=f3f1f07d-6095-412d-b47b-f9a0f20a02c2 2021-07-13T00:15:19.722Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=09bed864-80d3-46e5-8876-3b62706ffdf8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:19.761Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9abd4419-9900-43b7-a50e-5a162df5fb87 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.767Z [qtp817348612-54] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=9abd4419-9900-43b7-a50e-5a162df5fb87 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.767Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9abd4419-9900-43b7-a50e-5a162df5fb87 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.768Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=9abd4419-9900-43b7-a50e-5a162df5fb87 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=6355 EndTimestamp=2021-07-13T00:15:19.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:13.413Z InvocationID=6c74c8b0-0a17-46d2-a726-6e24f8d9b2a3 ResponseDesc=Internal Server Error 2021-07-13T00:15:19.816Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=49434b87-5fb9-42e0-8fba-528238470959 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:19.860Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=49434b87-5fb9-42e0-8fba-528238470959 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:20.214Z [qtp817348612-48] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=49785ae8-0c97-4094-861b-13b02a52e26e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureCassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:20.214Z [qtp817348612-48] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=49785ae8-0c97-4094-861b-13b02a52e26e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:20.214Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=49785ae8-0c97-4094-861b-13b02a52e26e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=22807 EndTimestamp=2021-07-13T00:15:20.214Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:57.407Z InvocationID=622ea470-3789-41d6-8f96-903dfb11938b ResponseDesc=Internal Server Error 2021-07-13T00:15:20.324Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=55490383-8ee2-4815-9da8-e44614f73104 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:20.324Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=55490383-8ee2-4815-9da8-e44614f73104 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:20.325Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=55490383-8ee2-4815-9da8-e44614f73104 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=14902 EndTimestamp=2021-07-13T00:15:20.325Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:05.423Z InvocationID=673d06ce-d5ce-404f-9f18-67a5c818d888 ResponseDesc=Internal Server Error 2021-07-13T00:15:20.325Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=2577deb8-fff1-47cf-96ad-9418039c685e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:20.325Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=2577deb8-fff1-47cf-96ad-9418039c685e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:20.326Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=49434b87-5fb9-42e0-8fba-528238470959 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:20.326Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=49434b87-5fb9-42e0-8fba-528238470959 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:20.326Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=2577deb8-fff1-47cf-96ad-9418039c685e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=2814 EndTimestamp=2021-07-13T00:15:20.326Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:17.512Z InvocationID=eddd94d3-fa80-48c9-97b0-1d6705641522 ResponseDesc=Internal Server Error 2021-07-13T00:15:20.327Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=49434b87-5fb9-42e0-8fba-528238470959 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=653 EndTimestamp=2021-07-13T00:15:20.326Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:19.673Z InvocationID=bd1f6ede-3249-4436-92e5-ca1543293955 ResponseDesc=Internal Server Error 2021-07-13T00:15:20.364Z [qtp817348612-53] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=09bed864-80d3-46e5-8876-3b62706ffdf8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:20.364Z [qtp817348612-56] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=ff11cd75-db2b-4297-ae54-7e78a54aa9be InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:20.364Z [qtp817348612-53] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=09bed864-80d3-46e5-8876-3b62706ffdf8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:20.364Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ff11cd75-db2b-4297-ae54-7e78a54aa9be InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:15:20.365Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=ff11cd75-db2b-4297-ae54-7e78a54aa9be InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=19196 EndTimestamp=2021-07-13T00:15:20.364Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:01.168Z InvocationID=5d85cc30-15de-480d-9762-8feb2c2dd942 ResponseDesc=Internal Server Error 2021-07-13T00:15:20.365Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=09bed864-80d3-46e5-8876-3b62706ffdf8 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=10958 EndTimestamp=2021-07-13T00:15:20.364Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:09.406Z InvocationID=14bb09e2-4887-44dc-b6aa-a8550bfb5f28 ResponseDesc=Internal Server Error 2021-07-13T00:15:21.472Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a62b906f-893c-4850-8bf3-3da0ccae2fc3 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:21.472Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:21.472Z InvocationID=51606ed1-254f-49c3-abf9-ee89882678b8 2021-07-13T00:15:21.560Z [qtp817348612-13] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a62b906f-893c-4850-8bf3-3da0ccae2fc3 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:22.219Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a62b906f-893c-4850-8bf3-3da0ccae2fc3 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:22.260Z [qtp817348612-13] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=a62b906f-893c-4850-8bf3-3da0ccae2fc3 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:22.260Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a62b906f-893c-4850-8bf3-3da0ccae2fc3 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:22.262Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=a62b906f-893c-4850-8bf3-3da0ccae2fc3 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=789 EndTimestamp=2021-07-13T00:15:22.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:21.472Z InvocationID=b8266a91-8c32-4e43-b50c-f30a90bc2128 ResponseDesc=Internal Server Error 2021-07-13T00:15:23.076Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6d87f1ce-b6ce-4ddd-baa7-2af1dfbcafae InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:23.075Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:23.075Z InvocationID=d3ca6b81-57ef-45ca-90f2-3f7ae5e278c2 2021-07-13T00:15:23.159Z [qtp817348612-55] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6d87f1ce-b6ce-4ddd-baa7-2af1dfbcafae InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:23.165Z [qtp817348612-55] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=6d87f1ce-b6ce-4ddd-baa7-2af1dfbcafae InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:23.171Z [qtp817348612-55] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=6d87f1ce-b6ce-4ddd-baa7-2af1dfbcafae InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:23.171Z [qtp817348612-55] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=6d87f1ce-b6ce-4ddd-baa7-2af1dfbcafae InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:23.172Z [qtp817348612-55] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=6d87f1ce-b6ce-4ddd-baa7-2af1dfbcafae InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=97 EndTimestamp=2021-07-13T00:15:23.172Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:23.075Z InvocationID=170bbb6f-9df1-4331-aba7-488ec531ca5e ResponseDesc=Internal Server Error 2021-07-13T00:15:23.331Z [qtp817348612-57] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=8ebd6ec7-5d52-46d2-8fc9-e8e89f2e6918 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:23.331Z [qtp817348612-57] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=8ebd6ec7-5d52-46d2-8fc9-e8e89f2e6918 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:15:23.332Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=8ebd6ec7-5d52-46d2-8fc9-e8e89f2e6918 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=24163 EndTimestamp=2021-07-13T00:15:23.332Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:14:59.169Z InvocationID=e6122857-0a6c-474e-9e1a-c9003be992d9 ResponseDesc=Internal Server Error 2021-07-13T00:15:24.077Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=11241b85-7b0e-4d79-b8ae-3f08ad80e46c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:24.077Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:24.077Z InvocationID=4f5ece06-55fc-4d73-95ca-2435d54b0c83 2021-07-13T00:15:27.224Z [qtp817348612-44] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=11241b85-7b0e-4d79-b8ae-3f08ad80e46c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:27.260Z [qtp817348612-44] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=11241b85-7b0e-4d79-b8ae-3f08ad80e46c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:27.314Z [qtp817348612-44] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=11241b85-7b0e-4d79-b8ae-3f08ad80e46c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:27.314Z [qtp817348612-44] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=11241b85-7b0e-4d79-b8ae-3f08ad80e46c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:27.316Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=11241b85-7b0e-4d79-b8ae-3f08ad80e46c InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=3239 EndTimestamp=2021-07-13T00:15:27.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:24.077Z InvocationID=cae57c34-f18c-4f55-b11e-68efc6c37a28 ResponseDesc=Internal Server Error 2021-07-13T00:15:28.513Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a4503afe-aecc-4846-acc5-0d287202ffbf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:28.513Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:28.513Z InvocationID=6d3fa7d2-afe5-4e75-961c-9a7c3b23a435 2021-07-13T00:15:28.564Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a4503afe-aecc-4846-acc5-0d287202ffbf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:28.571Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a4503afe-aecc-4846-acc5-0d287202ffbf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:28.660Z [qtp817348612-54] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=a4503afe-aecc-4846-acc5-0d287202ffbf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:28.661Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a4503afe-aecc-4846-acc5-0d287202ffbf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:15:28.662Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=a4503afe-aecc-4846-acc5-0d287202ffbf InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=148 EndTimestamp=2021-07-13T00:15:28.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:28.513Z InvocationID=6afde397-d648-4e7f-ac17-1653df2190e1 ResponseDesc=Internal Server Error 2021-07-13T00:15:28.874Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c0eb7220-7ac2-4cc1-9019-61f32aaf4258 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:28.874Z InvocationID=e2f4e5da-17b9-4c19-8cf1-930642ca3a2b 2021-07-13T00:15:29.869Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1ba6153b-3f20-4974-951c-9273e97ed32a InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:29.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:29.869Z InvocationID=94b72822-4d34-4944-8ad4-eb3e1275813d 2021-07-13T00:15:31.762Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1ba6153b-3f20-4974-951c-9273e97ed32a InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:15:31.819Z [qtp817348612-46] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c0eb7220-7ac2-4cc1-9019-61f32aaf4258 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:15:32.063Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1ba6153b-3f20-4974-951c-9273e97ed32a InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=2194 EndTimestamp=2021-07-13T00:15:32.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:29.869Z InvocationID=02582156-71ed-4f8a-9d02-0549fb75584a ResponseDesc=OK 2021-07-13T00:15:32.260Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c0eb7220-7ac2-4cc1-9019-61f32aaf4258 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=3385 EndTimestamp=2021-07-13T00:15:32.259Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:28.874Z InvocationID=7fadd048-9895-4756-9374-a450de40e33f ResponseDesc=OK 2021-07-13T00:15:33.535Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5a1582d3-2086-46fa-b58f-cfa9c828c379 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:33.534Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:33.534Z InvocationID=466e1ce6-cc8c-41e6-b5ae-324777e92d89 2021-07-13T00:15:33.667Z [qtp817348612-53] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5a1582d3-2086-46fa-b58f-cfa9c828c379 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:15:34.119Z [qtp817348612-53] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5a1582d3-2086-46fa-b58f-cfa9c828c379 InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=585 EndTimestamp=2021-07-13T00:15:34.119Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:33.534Z InvocationID=11057bfa-26bf-4d30-bded-251c8dd01146 ResponseDesc=OK 2021-07-13T00:15:35.071Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=906ee52e-cc2b-4af1-af71-a0273943d15f InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:35.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:35.071Z InvocationID=ccab5935-8551-4824-b9e4-59b879a62ebc 2021-07-13T00:15:35.216Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=906ee52e-cc2b-4af1-af71-a0273943d15f InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:15:35.573Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=906ee52e-cc2b-4af1-af71-a0273943d15f InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=501 EndTimestamp=2021-07-13T00:15:35.572Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:35.071Z InvocationID=f020915b-30b7-42d6-b4f8-5465ce10982c ResponseDesc=OK 2021-07-13T00:15:36.464Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=de946d82-976a-4b5a-a87e-6a5a2032543e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:36.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:36.463Z InvocationID=f83ea12e-9013-4bbb-9540-ed79289c5edf 2021-07-13T00:15:36.656Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=de946d82-976a-4b5a-a87e-6a5a2032543e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:15:37.158Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=de946d82-976a-4b5a-a87e-6a5a2032543e InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=695 EndTimestamp=2021-07-13T00:15:37.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:36.463Z InvocationID=fbc0b8ff-651c-4985-ad14-21b57fb4cca5 ResponseDesc=OK 2021-07-13T00:15:38.168Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a3455482-9c1a-43fc-8075-6677d42d23de InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:38.167Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:38.167Z InvocationID=77fbbb4f-618d-4e24-b020-50159c8710a8 2021-07-13T00:15:38.267Z [qtp817348612-57] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a3455482-9c1a-43fc-8075-6677d42d23de InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:15:38.875Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7cc25178-ef1b-438d-89f6-3834383895cc InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=0 EndTimestamp=2021-07-13T00:15:38.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:38.875Z InvocationID=a55304c2-2086-4d68-8ddd-ff554f7f6470 2021-07-13T00:15:40.413Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7cc25178-ef1b-438d-89f6-3834383895cc InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:15:40.413Z [qtp817348612-57] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a3455482-9c1a-43fc-8075-6677d42d23de InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=2246 EndTimestamp=2021-07-13T00:15:40.413Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:38.167Z InvocationID=6a98568f-1151-4d73-80d0-4267527bd279 ResponseDesc=OK 2021-07-13T00:15:40.760Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7cc25178-ef1b-438d-89f6-3834383895cc InstanceID=af17bce7-e9ec-4697-a894-e8128af26b7a ElapsedTime=1885 EndTimestamp=2021-07-13T00:15:40.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:15:38.875Z InvocationID=1be95749-32ff-4ad9-97f6-772cb37ed9ba ResponseDesc=OK 2021-07-13T00:16:01.954Z [main] INFO o.s.web.context.ContextLoader Root WebApplicationContext: initialization started 2021-07-13T00:16:02.914Z [main] INFO o.h.validator.internal.util.Version HV000001: Hibernate Validator 5.3.6.Final 2021-07-13T00:16:03.263Z [main] INFO com.datastax.driver.core DataStax Java driver 3.8.0 for Apache Cassandra 2021-07-13T00:16:03.270Z [main] INFO c.d.driver.core.GuavaCompatibility Detected Guava >= 19 in the classpath, using modern compatibility layer 2021-07-13T00:16:03.285Z [main] INFO o.o.c.n.i.c.CassandraSessionFactory localDatacenter was provided, setting Cassndra client to use datacenter: Pod as local. 2021-07-13T00:16:03.294Z [main] INFO c.d.driver.core.SystemProperties com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false 2021-07-13T00:16:03.294Z [main] INFO c.datastax.driver.core.ClockFactory Using java.lang.System clock to generate timestamps. 2021-07-13T00:16:03.371Z [main] INFO o.o.c.n.i.c.CassandraSessionFactory Cassandra client created hosts: [cassandra.onap] port: 9042 SSL enabled: false reconnectTimeout 2021-07-13T00:16:03.445Z [main] INFO com.datastax.driver.core.NettyUtil Did not find Netty's native epoll transport in the classpath, defaulting to NIO. 2021-07-13T00:16:04.329Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-07-13T00:16:04.331Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.219.208:9042 added 2021-07-13T00:16:04.331Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.199.132:9042 added 2021-07-13T00:16:04.332Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.211.142:9042 added 2021-07-13T00:16:16.380Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:16.381Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.199.132:9042] Pool was closed during initialization at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173) at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69) at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282) at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264) at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42) at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:17.650Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T00:16:17.682Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T00:16:17.766Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T00:16:17.768Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.user_candidate_version <-> org.openecomp.sdc.versioning.dao.types.UserCandidateVersion] because it collides with previously registered codec MappedUDTCodec [dox.user_candidate_version <-> org.openecomp.sdc.versioning.dao.types.UserCandidateVersion] 2021-07-13T00:16:18.647Z [main] INFO o.o.c.e.i.ExternalTestingManagerImpl loaded external testing config {"client":{"enabled":true},"endpoints":["vtp,VTP,true,http://refrepo:8702/onapapi/vnfsdk-marketplace,onap.*","repository,Repository,false,,.*"]} 2021-07-13T00:16:18.651Z [main] INFO o.o.c.e.i.ExternalTestingManagerImpl processed external testing config [{"enabled":true,"title":"VTP","url":"http://refrepo:8702/onapapi/vnfsdk-marketplace","id":"vtp","apiKey":null,"scenarioFilter":"onap.*"},{"enabled":false,"title":"Repository","url":"","id":"repository","apiKey":null,"scenarioFilter":".*"}] 2021-07-13T00:16:19.388Z [main] INFO org.apache.cxf.endpoint.ServerImpl Setting the server's publish address to be / 2021-07-13T00:16:19.475Z [main] INFO o.s.web.context.ContextLoader Root WebApplicationContext initialized in 17518 ms 2021-07-13T00:16:21.830Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T00:16:21.950Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T00:16:21.976Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T00:16:22.353Z [main] INFO o.s.web.servlet.DispatcherServlet Initializing Servlet 'spring-mapper' 2021-07-13T00:16:22.514Z [main] INFO o.s.web.servlet.DispatcherServlet Completed initialization in 160 ms 2021-07-13T00:16:22.786Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:22.778Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:22.778Z InvocationID=126592ce-41a2-4571-9c1e-a6f24a449acb PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:22.786Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=79e928b9-2bda-41c2-955d-85c0ec688e77 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:22.779Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:22.779Z InvocationID=fc569584-d225-4408-9990-95a7a5905ed6 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:23.153Z [qtp817348612-14] INFO c.d.driver.core.SystemProperties RequestID=79e928b9-2bda-41c2-955d-85c0ec688e77 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false 2021-07-13T00:16:23.153Z [qtp817348612-14] INFO c.datastax.driver.core.ClockFactory RequestID=79e928b9-2bda-41c2-955d-85c0ec688e77 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Using java.lang.System clock to generate timestamps. 2021-07-13T00:16:23.298Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=19cd4c71-757c-4d32-a746-e1cef54c02c2 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:23.298Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:23.298Z InvocationID=5d5cc49e-8722-4b88-8b76-f05ce6dca33c PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:24.527Z [qtp817348612-13] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-07-13T00:16:24.527Z [qtp817348612-13] INFO com.datastax.driver.core.Cluster RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.219.208:9042 added 2021-07-13T00:16:24.527Z [qtp817348612-13] INFO com.datastax.driver.core.Cluster RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.199.132:9042 added 2021-07-13T00:16:24.527Z [qtp817348612-13] INFO com.datastax.driver.core.Cluster RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.211.142:9042 added 2021-07-13T00:16:27.232Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f544bbe7-236e-4110-b87f-aafb7a19f6c6 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:27.231Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:27.231Z InvocationID=9a2476ca-5ae2-4827-806b-10210d26b8da PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:31.212Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=de93bfc5-92e8-4e0c-84ba-c06e9ff1d50a ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:31.211Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:31.211Z InvocationID=080e3370-7320-4b6c-bc0c-b657f61d970b PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:32.333Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4d2e51d7-f93f-49e0-921a-f76f0aa90c6e ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:32.333Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:32.333Z InvocationID=b426c6b3-2883-46cd-9da8-b4bee853551e PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:35.414Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=21edecb2-abf0-4be5-903b-353506ceb552 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:35.414Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:35.414Z InvocationID=db95cf38-a8d4-4aa8-9394-e55246cf6a20 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:35.620Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:35.626Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:35.632Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:35.762Z [qtp817348612-46] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=de93bfc5-92e8-4e0c-84ba-c06e9ff1d50a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:35.872Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=de93bfc5-92e8-4e0c-84ba-c06e9ff1d50a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:35.963Z [qtp817348612-46] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=de93bfc5-92e8-4e0c-84ba-c06e9ff1d50a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:35.963Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=de93bfc5-92e8-4e0c-84ba-c06e9ff1d50a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:35.974Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=de93bfc5-92e8-4e0c-84ba-c06e9ff1d50a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=4762 EndTimestamp=2021-07-13T00:16:35.973Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:31.211Z InvocationID=bf67f526-7442-4c4f-a6eb-33f279e65126 ResponseDesc=Internal Server Error 2021-07-13T00:16:36.313Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:36.360Z [qtp817348612-18] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=21edecb2-abf0-4be5-903b-353506ceb552 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:36.365Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=21edecb2-abf0-4be5-903b-353506ceb552 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:36.371Z [qtp817348612-18] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=21edecb2-abf0-4be5-903b-353506ceb552 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:36.371Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=21edecb2-abf0-4be5-903b-353506ceb552 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:36.372Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=21edecb2-abf0-4be5-903b-353506ceb552 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=957 EndTimestamp=2021-07-13T00:16:36.371Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:35.414Z InvocationID=1b69001d-9316-43c3-a384-314affa74ece ResponseDesc=Internal Server Error 2021-07-13T00:16:37.264Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4076015a-300f-4eff-bf9f-e5b8ac8e4b94 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:37.263Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:37.263Z InvocationID=523b5d1f-ff60-4e22-b698-2b5aef03b210 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:37.272Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4076015a-300f-4eff-bf9f-e5b8ac8e4b94 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:37.362Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4076015a-300f-4eff-bf9f-e5b8ac8e4b94 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:37.371Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=4076015a-300f-4eff-bf9f-e5b8ac8e4b94 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:37.371Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4076015a-300f-4eff-bf9f-e5b8ac8e4b94 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:37.372Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=4076015a-300f-4eff-bf9f-e5b8ac8e4b94 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=109 EndTimestamp=2021-07-13T00:16:37.372Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:37.263Z InvocationID=b170d300-fe21-4b37-9489-c02dc6e204a6 ResponseDesc=Internal Server Error 2021-07-13T00:16:38.020Z [cluster2-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.029Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.112Z [cluster2-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.113Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.116Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.119Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.157Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=19cd4c71-757c-4d32-a746-e1cef54c02c2 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.159Z [qtp817348612-14] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=79e928b9-2bda-41c2-955d-85c0ec688e77 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.160Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4d2e51d7-f93f-49e0-921a-f76f0aa90c6e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.166Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=19cd4c71-757c-4d32-a746-e1cef54c02c2 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:16:38.168Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4d2e51d7-f93f-49e0-921a-f76f0aa90c6e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.170Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=79e928b9-2bda-41c2-955d-85c0ec688e77 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.234Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.240Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.242Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.244Z [cluster2-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.260Z [qtp817348612-13] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.260Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f544bbe7-236e-4110-b87f-aafb7a19f6c6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:38.262Z [qtp817348612-17] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=19cd4c71-757c-4d32-a746-e1cef54c02c2 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:16:38.262Z [qtp817348612-14] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=79e928b9-2bda-41c2-955d-85c0ec688e77 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.262Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=79e928b9-2bda-41c2-955d-85c0ec688e77 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.262Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=19cd4c71-757c-4d32-a746-e1cef54c02c2 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:16:38.263Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=79e928b9-2bda-41c2-955d-85c0ec688e77 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=15484 EndTimestamp=2021-07-13T00:16:38.263Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:22.779Z InvocationID=63f57bb5-43de-44bd-9209-e03583010aff ResponseDesc=Internal Server Error 2021-07-13T00:16:38.267Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=19cd4c71-757c-4d32-a746-e1cef54c02c2 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=14965 EndTimestamp=2021-07-13T00:16:38.263Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:23.298Z InvocationID=95b08ea4-44f4-4dd2-97c0-8aa6f5b043ec ResponseDesc=Internal Server Error 2021-07-13T00:16:38.267Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=4d2e51d7-f93f-49e0-921a-f76f0aa90c6e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.268Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4d2e51d7-f93f-49e0-921a-f76f0aa90c6e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.269Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=4d2e51d7-f93f-49e0-921a-f76f0aa90c6e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=5935 EndTimestamp=2021-07-13T00:16:38.268Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:32.333Z InvocationID=ae66d922-8224-4f0d-9571-e6d5771fb4d4 ResponseDesc=Internal Server Error 2021-07-13T00:16:38.275Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.275Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f544bbe7-236e-4110-b87f-aafb7a19f6c6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.365Z [qtp817348612-13] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.366Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=f544bbe7-236e-4110-b87f-aafb7a19f6c6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.365Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.366Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f544bbe7-236e-4110-b87f-aafb7a19f6c6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.367Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=20c2532a-857b-41f7-ae93-1c4321eea23a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=15589 EndTimestamp=2021-07-13T00:16:38.367Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:22.778Z InvocationID=3f6e284b-589a-48c2-bea0-3b3e00fad89f ResponseDesc=Internal Server Error 2021-07-13T00:16:38.367Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f544bbe7-236e-4110-b87f-aafb7a19f6c6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=11136 EndTimestamp=2021-07-13T00:16:38.367Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:27.231Z InvocationID=1ae4c0d8-3cc2-4a6c-8dfe-3484cc1ad02c ResponseDesc=Internal Server Error 2021-07-13T00:16:38.564Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da308f44-cf22-4e26-b2c3-f5b4c5a97d76 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:38.564Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:38.564Z InvocationID=0644c56d-f03d-463c-be7f-ae47db93dabe PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:38.574Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da308f44-cf22-4e26-b2c3-f5b4c5a97d76 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.662Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=da308f44-cf22-4e26-b2c3-f5b4c5a97d76 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.668Z [qtp817348612-11] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=da308f44-cf22-4e26-b2c3-f5b4c5a97d76 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.669Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=da308f44-cf22-4e26-b2c3-f5b4c5a97d76 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:16:38.670Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=da308f44-cf22-4e26-b2c3-f5b4c5a97d76 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=106 EndTimestamp=2021-07-13T00:16:38.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:38.564Z InvocationID=63d8d1a4-7e0d-4121-81ef-7d49959b05b5 ResponseDesc=Internal Server Error 2021-07-13T00:16:39.563Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=870491d8-6f18-47d0-acc7-f14499d368e2 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:39.563Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:39.563Z InvocationID=14934285-c563-4bff-8718-4e4ccce9e387 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:42.336Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bb16da9c-8072-4e2e-ae08-2a3a1b7a8427 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:16:42.336Z ElapsedTime=0 EndTimestamp=2021-07-13T00:16:42.336Z InvocationID=82e731a3-c29b-46b9-9f11-102e67c0207d PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:16:43.513Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7ceffc45-7131-4331-b5e5-7a6a8d940297 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:43.513Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:43.513Z InvocationID=5c413a1b-bfe3-486c-8ef3-20e5b6e8cd29 2021-07-13T00:16:47.510Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1992044d-da29-4ddb-ad36-5b3d2d60352f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:47.509Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:47.509Z InvocationID=1c038ef3-5eb6-46a8-8080-933e2aa2cfc6 2021-07-13T00:16:48.058Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=870491d8-6f18-47d0-acc7-f14499d368e2 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:16:48.060Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7ceffc45-7131-4331-b5e5-7a6a8d940297 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:16:48.060Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bb16da9c-8072-4e2e-ae08-2a3a1b7a8427 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:16:48.061Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1992044d-da29-4ddb-ad36-5b3d2d60352f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:16:48.367Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bb16da9c-8072-4e2e-ae08-2a3a1b7a8427 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=6031 EndTimestamp=2021-07-13T00:16:48.367Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:42.336Z InvocationID=85a6424e-4a83-4e3b-adcd-a3147e51aee9 ResponseDesc=OK 2021-07-13T00:16:48.367Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1992044d-da29-4ddb-ad36-5b3d2d60352f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=858 EndTimestamp=2021-07-13T00:16:48.367Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:47.509Z InvocationID=c2bbfa87-f909-4211-a6c9-dfff99f61929 ResponseDesc=OK 2021-07-13T00:16:48.459Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7ceffc45-7131-4331-b5e5-7a6a8d940297 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=4946 EndTimestamp=2021-07-13T00:16:48.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:43.513Z InvocationID=a85e59bd-d45e-401a-979e-97047cb960b4 ResponseDesc=OK 2021-07-13T00:16:48.459Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=870491d8-6f18-47d0-acc7-f14499d368e2 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=8896 EndTimestamp=2021-07-13T00:16:48.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:39.563Z InvocationID=bf6c750a-61c1-4ff9-bd70-1caf3b33440a ResponseDesc=OK 2021-07-13T00:16:48.875Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3ed15a3d-eadb-4919-b378-bc7f74cb178f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:48.875Z InvocationID=ab94c23f-3c95-401d-aeaf-5b2a7f62b608 2021-07-13T00:16:49.156Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3ed15a3d-eadb-4919-b378-bc7f74cb178f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:16:49.376Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be15777c-ba34-4668-8420-bae61404b830 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:49.376Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:49.376Z InvocationID=0c7f0084-b4e5-4540-8a28-8f6e0a4bb2fc 2021-07-13T00:16:49.460Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3ed15a3d-eadb-4919-b378-bc7f74cb178f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=584 EndTimestamp=2021-07-13T00:16:49.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:48.875Z InvocationID=b0372b22-0ee6-4d2f-9ee0-e8b4b3011034 ResponseDesc=OK 2021-07-13T00:16:49.656Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be15777c-ba34-4668-8420-bae61404b830 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:16:49.862Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be15777c-ba34-4668-8420-bae61404b830 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=485 EndTimestamp=2021-07-13T00:16:49.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:49.376Z InvocationID=603220b6-bb74-4504-a801-696f28e6a277 ResponseDesc=OK 2021-07-13T00:16:50.969Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dbf7ea24-cd9c-412f-b148-bc48f0b5a362 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:50.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:50.968Z InvocationID=0e770461-9628-40e6-94b9-0bf582d7b8f9 2021-07-13T00:16:51.357Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dbf7ea24-cd9c-412f-b148-bc48f0b5a362 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:16:51.860Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dbf7ea24-cd9c-412f-b148-bc48f0b5a362 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=891 EndTimestamp=2021-07-13T00:16:51.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:50.968Z InvocationID=b88fe40e-0aa5-4775-b792-424cb6622a13 ResponseDesc=OK 2021-07-13T00:16:53.069Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6b4c4019-9527-43ea-a191-673ab909bcf7 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:53.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:53.069Z InvocationID=171bba4d-9de4-4fcd-9acb-4b399c523e12 2021-07-13T00:16:53.257Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6b4c4019-9527-43ea-a191-673ab909bcf7 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:16:54.024Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-07-13T00:16:54.025Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.199.132:9042, scheduling retry in 30000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:16:54.260Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6b4c4019-9527-43ea-a191-673ab909bcf7 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=1191 EndTimestamp=2021-07-13T00:16:54.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:53.069Z InvocationID=2dac7b5e-ec93-4612-8b6f-1d0f3390a7a6 ResponseDesc=OK 2021-07-13T00:16:55.474Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9da5540e-6b49-46d4-959d-a321cf03d2fa InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:55.473Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:55.473Z InvocationID=caea2e6c-4bc3-43ac-b83f-d6aaa99a9d7b 2021-07-13T00:16:57.441Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=50732380-7f24-4aaa-af8c-4cc4bd4ff603 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:57.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:57.441Z InvocationID=0dd3da85-d23c-40ad-bf91-95ef7dcd735e 2021-07-13T00:16:58.875Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=01d77432-01be-48c9-b0f3-db508066bbfe InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:58.874Z InvocationID=a4c392f6-dd39-4176-9687-23e050581748 2021-07-13T00:16:59.626Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2489dd61-001a-450c-8d74-5adf47c1d265 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:16:59.625Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:59.625Z InvocationID=f2fa1420-b19b-4d57-892d-6e28cdadc57a 2021-07-13T00:17:03.608Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1d201f04-6da0-4cc5-8ece-03c6b56f27f3 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:03.608Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:03.608Z InvocationID=c7856dfa-d7ec-4e1c-bccc-0e343cf975dd 2021-07-13T00:17:05.560Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9da5540e-6b49-46d4-959d-a321cf03d2fa InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:17:06.082Z [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:06.271Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:06.282Z [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:06.283Z [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:06.283Z [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:06.285Z [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:06.286Z [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:06.287Z [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.199.132:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:07.317Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=956c5466-cc2e-43fc-b994-6bb9f5dc559b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:07.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:07.316Z InvocationID=960e3012-50dd-4c4d-a4d2-e8b8cd02d154 2021-07-13T00:17:07.464Z [qtp817348612-14] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=50732380-7f24-4aaa-af8c-4cc4bd4ff603 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:17:08.659Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2489dd61-001a-450c-8d74-5adf47c1d265 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:08.659Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=01d77432-01be-48c9-b0f3-db508066bbfe InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:08.660Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1d201f04-6da0-4cc5-8ece-03c6b56f27f3 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:08.761Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=956c5466-cc2e-43fc-b994-6bb9f5dc559b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:08.766Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=50732380-7f24-4aaa-af8c-4cc4bd4ff603 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=11324 EndTimestamp=2021-07-13T00:17:08.765Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:57.441Z InvocationID=15725049-08ef-432e-86f1-f5096db34166 ResponseDesc=Internal Server Error 2021-07-13T00:17:08.772Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=128bc708-2c25-4813-8337-fe65b61a1aa5 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:08.771Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:08.771Z InvocationID=1985c817-073a-4885-ba6b-90bf8999de40 2021-07-13T00:17:08.860Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=9da5540e-6b49-46d4-959d-a321cf03d2fa InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=13387 EndTimestamp=2021-07-13T00:17:08.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:55.473Z InvocationID=4ede3ca9-8a80-4740-a5a2-ed9cd81ff92c ResponseDesc=Internal Server Error 2021-07-13T00:17:08.964Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2489dd61-001a-450c-8d74-5adf47c1d265 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=9338 EndTimestamp=2021-07-13T00:17:08.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:59.625Z InvocationID=b0fabedf-f243-4efc-9b11-306eb6ad4386 ResponseDesc=OK 2021-07-13T00:17:09.371Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=01d77432-01be-48c9-b0f3-db508066bbfe InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=10497 EndTimestamp=2021-07-13T00:17:09.371Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:16:58.874Z InvocationID=7c11e899-b2c7-4d12-90c0-8c92dbcb253f ResponseDesc=OK 2021-07-13T00:17:09.372Z [qtp817348612-46] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=128bc708-2c25-4813-8337-fe65b61a1aa5 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:09.373Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=956c5466-cc2e-43fc-b994-6bb9f5dc559b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=2056 EndTimestamp=2021-07-13T00:17:09.372Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:07.316Z InvocationID=00a256d0-ff8c-4009-bef4-d2b9c72527ef ResponseDesc=OK 2021-07-13T00:17:09.376Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d7d3eb39-0058-4be3-90d6-7c18b829111a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:09.376Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:09.376Z InvocationID=4daadc41-1515-4fee-8044-1c8442177df4 2021-07-13T00:17:09.461Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1d201f04-6da0-4cc5-8ece-03c6b56f27f3 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=5852 EndTimestamp=2021-07-13T00:17:09.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:03.608Z InvocationID=28659c82-d337-45ce-82a0-5813c121d0b4 ResponseDesc=OK 2021-07-13T00:17:10.674Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8417b455-4eca-4ec0-9310-144f7fad8428 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:10.674Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:10.674Z InvocationID=bd69ed08-0989-45f2-9fa2-8340ec5a99c1 2021-07-13T00:17:14.013Z [qtp817348612-54] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8417b455-4eca-4ec0-9310-144f7fad8428 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:14.056Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d7d3eb39-0058-4be3-90d6-7c18b829111a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:14.915Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f696fbe9-05e8-4551-9631-1c036aef4e78 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:14.915Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:14.915Z InvocationID=93957054-0c7f-4687-baf4-ca81b90cc55e 2021-07-13T00:17:16.158Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f696fbe9-05e8-4551-9631-1c036aef4e78 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:16.159Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=128bc708-2c25-4813-8337-fe65b61a1aa5 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=7388 EndTimestamp=2021-07-13T00:17:16.159Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:08.771Z InvocationID=be969ada-94fb-487d-9b55-45f64fffa210 ResponseDesc=OK 2021-07-13T00:17:16.262Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d7d3eb39-0058-4be3-90d6-7c18b829111a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=6886 EndTimestamp=2021-07-13T00:17:16.262Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:09.376Z InvocationID=f455340c-eace-4cfc-92a5-7af646df6fc2 ResponseDesc=OK 2021-07-13T00:17:16.361Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8417b455-4eca-4ec0-9310-144f7fad8428 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=5686 EndTimestamp=2021-07-13T00:17:16.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:10.674Z InvocationID=a2fce4e2-8239-4f29-8057-97b9781495ca ResponseDesc=OK 2021-07-13T00:17:16.461Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f696fbe9-05e8-4551-9631-1c036aef4e78 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=1546 EndTimestamp=2021-07-13T00:17:16.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:14.915Z InvocationID=53755df2-7a09-4ad9-97f2-e93aeafc4842 ResponseDesc=OK 2021-07-13T00:17:17.441Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=36d6dbc3-2e61-415d-a032-70630b3aee04 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:17.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:17.441Z InvocationID=85050b63-a4bb-4169-8649-ab0e05c1fe4e 2021-07-13T00:17:17.656Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=36d6dbc3-2e61-415d-a032-70630b3aee04 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:17.862Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8acfb880-a101-456b-b40e-dbaade561e20 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:17.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:17.861Z InvocationID=80a02ddd-2401-4072-930d-000b7eb41da4 2021-07-13T00:17:18.058Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8acfb880-a101-456b-b40e-dbaade561e20 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:18.060Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=36d6dbc3-2e61-415d-a032-70630b3aee04 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=619 EndTimestamp=2021-07-13T00:17:18.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:17.441Z InvocationID=38c3bc2d-92ba-4f65-a1a9-0278faaed642 ResponseDesc=OK 2021-07-13T00:17:18.262Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8acfb880-a101-456b-b40e-dbaade561e20 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=400 EndTimestamp=2021-07-13T00:17:18.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:17.861Z InvocationID=82dbae59-b320-4e40-a483-6c285ef2edaa ResponseDesc=OK 2021-07-13T00:17:18.875Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4574f494-fffe-4fe8-8fe0-0702230ce83a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:18.874Z InvocationID=789c6627-64cc-4428-8c17-3c4352d336a3 2021-07-13T00:17:19.057Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4574f494-fffe-4fe8-8fe0-0702230ce83a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:24.159Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4574f494-fffe-4fe8-8fe0-0702230ce83a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=5285 EndTimestamp=2021-07-13T00:17:24.159Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:18.874Z InvocationID=41d13782-2567-457f-8c15-33b49827a1a7 ResponseDesc=OK 2021-07-13T00:17:27.442Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ccd842d9-d596-4bc3-b62e-661ede9cd5f7 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:27.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:27.442Z InvocationID=0f6e194e-9134-40e8-8ca3-a608b24b5778 2021-07-13T00:17:28.874Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d2eeb0a3-c54b-42ca-b340-15971027ef83 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:28.874Z InvocationID=91c94072-62fe-42ff-9364-651aa92e959b 2021-07-13T00:17:37.467Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ccd842d9-d596-4bc3-b62e-661ede9cd5f7 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:17:37.944Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5d3cd9a-fe80-4c56-8ea9-2d4b4ca01816 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:37.944Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:37.944Z InvocationID=48584640-cec1-41bf-9847-fd3b81a1ebc8 2021-07-13T00:17:38.884Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d2eeb0a3-c54b-42ca-b340-15971027ef83 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:17:42.106Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d2f3da27-0506-495b-a9f6-3bf1af7b1d6d InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:42.106Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:42.106Z InvocationID=0c3eb65f-fe83-491d-8502-a80b2cf1936d 2021-07-13T00:17:42.439Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d302a6d6-70c4-4e54-b04d-c2e9078baebe InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:42.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:42.439Z InvocationID=b317812c-7ae1-458e-81c2-a3867da692ac 2021-07-13T00:17:43.257Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d302a6d6-70c4-4e54-b04d-c2e9078baebe InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:43.418Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d302a6d6-70c4-4e54-b04d-c2e9078baebe InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=979 EndTimestamp=2021-07-13T00:17:43.418Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:42.439Z InvocationID=45a8d86c-70c4-43d1-968f-d96aceb9b4d6 ResponseDesc=OK 2021-07-13T00:17:43.458Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d2eeb0a3-c54b-42ca-b340-15971027ef83 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=14584 EndTimestamp=2021-07-13T00:17:43.458Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:28.874Z InvocationID=eb01af57-b0ec-460d-a6d2-68e307f82892 ResponseDesc=Internal Server Error 2021-07-13T00:17:43.466Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f643e38e-51fb-42db-a2a2-0ddfb8fab86e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:43.466Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:43.466Z InvocationID=9f57b379-f9d3-4d8b-8153-1ab8d17cc74e 2021-07-13T00:17:43.523Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=ccd842d9-d596-4bc3-b62e-661ede9cd5f7 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=16081 EndTimestamp=2021-07-13T00:17:43.523Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:27.442Z InvocationID=72a55611-4bde-4446-bb49-9a44dc242586 ResponseDesc=Internal Server Error 2021-07-13T00:17:43.629Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-07-13T00:17:43.630Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.199.132:9042, scheduling retry in 30000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:43.635Z [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-07-13T00:17:43.636Z [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.199.132:9042, scheduling retry in 30000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:17:43.657Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f643e38e-51fb-42db-a2a2-0ddfb8fab86e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:44.258Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f643e38e-51fb-42db-a2a2-0ddfb8fab86e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=792 EndTimestamp=2021-07-13T00:17:44.258Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:43.466Z InvocationID=d3e83d56-faca-4a21-9c92-50bfa7a83992 ResponseDesc=OK 2021-07-13T00:17:45.259Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d2f3da27-0506-495b-a9f6-3bf1af7b1d6d InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:45.460Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d2f3da27-0506-495b-a9f6-3bf1af7b1d6d InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=3354 EndTimestamp=2021-07-13T00:17:45.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:42.106Z InvocationID=6f6d66b5-fdb7-4de0-a8e1-18b334296e14 ResponseDesc=OK 2021-07-13T00:17:46.018Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4cf93231-7b81-4cac-91a5-ad0126428722 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:46.018Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:46.018Z InvocationID=8f970354-8a5f-4133-9952-8d7ba3c1c618 2021-07-13T00:17:46.159Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4cf93231-7b81-4cac-91a5-ad0126428722 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:17:46.358Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4cf93231-7b81-4cac-91a5-ad0126428722 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=340 EndTimestamp=2021-07-13T00:17:46.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:46.018Z InvocationID=195e549e-a8f3-4f7e-b5c4-14f18bfdc9b7 ResponseDesc=OK 2021-07-13T00:17:47.441Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=34681468-991a-4464-9a02-21c9c881d3a4 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:47.440Z InvocationID=0b9f00d5-119f-4864-b3d9-27bc2b7518cd 2021-07-13T00:17:47.469Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=92362a7e-90e0-471e-af2a-5d01e87a1225 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:47.469Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:47.469Z InvocationID=e1524b29-4315-4e9f-9730-06b1e67e6eca 2021-07-13T00:17:47.960Z [qtp817348612-46] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5d3cd9a-fe80-4c56-8ea9-2d4b4ca01816 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:17:48.874Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=96b5aec6-87a9-4874-9264-eb8ae406d6eb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:48.874Z InvocationID=7f16d609-20f0-4d12-9516-13ddcaf8afae 2021-07-13T00:17:51.514Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0ad41467-ac01-4bd0-85ea-fe854a908681 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:51.514Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:51.514Z InvocationID=e85bdaf3-e5c9-497f-8e13-a9c16bf94a04 2021-07-13T00:17:55.497Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5b33862-050f-4354-b16f-cc72fa99f9f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:55.497Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:55.497Z InvocationID=8f4be2c7-285c-43ad-b02d-a15dce3846ae 2021-07-13T00:17:57.461Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=34681468-991a-4464-9a02-21c9c881d3a4 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:17:57.558Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=92362a7e-90e0-471e-af2a-5d01e87a1225 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:17:57.964Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f5d3cd9a-fe80-4c56-8ea9-2d4b4ca01816 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:17:58.879Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=96b5aec6-87a9-4874-9264-eb8ae406d6eb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:17:59.513Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4f564e40-994b-41aa-8a1f-176a7cbcfb2b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:17:59.513Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:59.513Z InvocationID=75b75d20-fdd1-4dbe-a6ee-97e0c5454d1d 2021-07-13T00:18:01.565Z [qtp817348612-13] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0ad41467-ac01-4bd0-85ea-fe854a908681 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:02.442Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a4fa55a3-ab70-4996-8322-5e82caa17cf8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:02.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:02.442Z InvocationID=a6d61c2a-b694-41cd-8d10-02c5132a6b49 2021-07-13T00:18:03.500Z [qtp817348612-63] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0d0489d6-b917-4fe6-9c92-f6877204dca0 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:18:03.500Z ElapsedTime=0 EndTimestamp=2021-07-13T00:18:03.500Z InvocationID=e1d39169-19b7-46a5-8ed4-be1c4f0ab33a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:18:03.875Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=545b4d71-dd63-48f8-94f3-d19c2ccb517d InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:03.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:03.875Z InvocationID=f68a2198-9af9-4e6d-9e5e-34e760693974 2021-07-13T00:18:05.559Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5b33862-050f-4354-b16f-cc72fa99f9f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.466Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=34681468-991a-4464-9a02-21c9c881d3a4 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.484Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=34681468-991a-4464-9a02-21c9c881d3a4 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.484Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=34681468-991a-4464-9a02-21c9c881d3a4 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.485Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=34681468-991a-4464-9a02-21c9c881d3a4 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=20044 EndTimestamp=2021-07-13T00:18:07.484Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:47.440Z InvocationID=8750c04d-e5fc-4140-8f8a-460fb2d9987f ResponseDesc=Internal Server Error 2021-07-13T00:18:07.562Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=92362a7e-90e0-471e-af2a-5d01e87a1225 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.569Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=92362a7e-90e0-471e-af2a-5d01e87a1225 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.569Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=92362a7e-90e0-471e-af2a-5d01e87a1225 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.569Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=92362a7e-90e0-471e-af2a-5d01e87a1225 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=20100 EndTimestamp=2021-07-13T00:18:07.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:47.469Z InvocationID=c3046bbd-5642-497c-b117-aa8db75d5d02 ResponseDesc=Internal Server Error 2021-07-13T00:18:07.603Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3f251716-3798-481c-a1ce-cc314b41c15c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:07.603Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:07.603Z InvocationID=371bac98-7bcb-46c1-a540-748ccea9a75c 2021-07-13T00:18:07.662Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3f251716-3798-481c-a1ce-cc314b41c15c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.669Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3f251716-3798-481c-a1ce-cc314b41c15c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.674Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=3f251716-3798-481c-a1ce-cc314b41c15c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.675Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3f251716-3798-481c-a1ce-cc314b41c15c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.676Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=3f251716-3798-481c-a1ce-cc314b41c15c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=72 EndTimestamp=2021-07-13T00:18:07.675Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:07.603Z InvocationID=39c24cc2-83d9-426b-8d43-c5e83914f1f1 ResponseDesc=Internal Server Error 2021-07-13T00:18:07.969Z [qtp817348612-46] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=f5d3cd9a-fe80-4c56-8ea9-2d4b4ca01816 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureCassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.969Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f5d3cd9a-fe80-4c56-8ea9-2d4b4ca01816 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:07.970Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f5d3cd9a-fe80-4c56-8ea9-2d4b4ca01816 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=30026 EndTimestamp=2021-07-13T00:18:07.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:37.944Z InvocationID=9b1da0ed-fd6a-47f8-a216-8d8bfa0a4a4e ResponseDesc=Internal Server Error 2021-07-13T00:18:08.377Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ed960a02-deb5-4ab5-b1fe-881e4e940b34 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:08.377Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:08.377Z InvocationID=5b349e0f-472e-4f2c-81ec-9bf1b44930c1 2021-07-13T00:18:08.464Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ed960a02-deb5-4ab5-b1fe-881e4e940b34 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:08.471Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ed960a02-deb5-4ab5-b1fe-881e4e940b34 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:08.477Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=ed960a02-deb5-4ab5-b1fe-881e4e940b34 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:08.478Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ed960a02-deb5-4ab5-b1fe-881e4e940b34 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:08.479Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=ed960a02-deb5-4ab5-b1fe-881e4e940b34 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=102 EndTimestamp=2021-07-13T00:18:08.479Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:08.377Z InvocationID=c4ba345c-2d11-4c17-aa4e-722bd3e8d315 ResponseDesc=Internal Server Error 2021-07-13T00:18:08.962Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=96b5aec6-87a9-4874-9264-eb8ae406d6eb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:08.971Z [qtp817348612-54] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=96b5aec6-87a9-4874-9264-eb8ae406d6eb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:08.971Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=96b5aec6-87a9-4874-9264-eb8ae406d6eb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:08.972Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=96b5aec6-87a9-4874-9264-eb8ae406d6eb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=20098 EndTimestamp=2021-07-13T00:18:08.972Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:48.874Z InvocationID=5c0a7eb2-bbc1-4527-833f-5e18a031ad2e ResponseDesc=Internal Server Error 2021-07-13T00:18:09.277Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=625388ed-fc6e-44a2-8792-9f8d0a9b4eac ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:18:09.277Z ElapsedTime=0 EndTimestamp=2021-07-13T00:18:09.277Z InvocationID=ed246cfb-6551-4433-9f50-e055d37608e4 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:18:09.368Z [qtp817348612-65] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=625388ed-fc6e-44a2-8792-9f8d0a9b4eac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:09.469Z [qtp817348612-65] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=625388ed-fc6e-44a2-8792-9f8d0a9b4eac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:09.558Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4f564e40-994b-41aa-8a1f-176a7cbcfb2b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:09.563Z [qtp817348612-65] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=625388ed-fc6e-44a2-8792-9f8d0a9b4eac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:09.564Z [qtp817348612-65] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=625388ed-fc6e-44a2-8792-9f8d0a9b4eac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:09.564Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=625388ed-fc6e-44a2-8792-9f8d0a9b4eac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=287 EndTimestamp=2021-07-13T00:18:09.564Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:09.277Z InvocationID=83cb28f2-1a21-4d06-ab49-b844934f50ea ResponseDesc=Internal Server Error 2021-07-13T00:18:09.569Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4f564e40-994b-41aa-8a1f-176a7cbcfb2b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:09.763Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=4f564e40-994b-41aa-8a1f-176a7cbcfb2b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:09.763Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4f564e40-994b-41aa-8a1f-176a7cbcfb2b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:09.763Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=4f564e40-994b-41aa-8a1f-176a7cbcfb2b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=10250 EndTimestamp=2021-07-13T00:18:09.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:59.513Z InvocationID=7b6b8bbc-efb7-4613-972b-c9c56b527594 ResponseDesc=Internal Server Error 2021-07-13T00:18:10.668Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=284cfc8c-0170-43b0-8283-8e828c76402e ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:18:10.668Z ElapsedTime=0 EndTimestamp=2021-07-13T00:18:10.668Z InvocationID=d43093eb-8a16-41d5-8387-e3d970e9acbe PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:18:10.760Z [qtp817348612-64] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=284cfc8c-0170-43b0-8283-8e828c76402e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:10.768Z [qtp817348612-64] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=284cfc8c-0170-43b0-8283-8e828c76402e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:10.861Z [qtp817348612-64] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=284cfc8c-0170-43b0-8283-8e828c76402e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:10.861Z [qtp817348612-64] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=284cfc8c-0170-43b0-8283-8e828c76402e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:10.863Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=284cfc8c-0170-43b0-8283-8e828c76402e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=194 EndTimestamp=2021-07-13T00:18:10.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:10.668Z InvocationID=22d736b2-8fec-4b55-bd46-6067bdbd32ce ResponseDesc=Internal Server Error 2021-07-13T00:18:11.569Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0ad41467-ac01-4bd0-85ea-fe854a908681 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:11.574Z [qtp817348612-13] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=0ad41467-ac01-4bd0-85ea-fe854a908681 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:11.574Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0ad41467-ac01-4bd0-85ea-fe854a908681 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:11.575Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=0ad41467-ac01-4bd0-85ea-fe854a908681 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=20061 EndTimestamp=2021-07-13T00:18:11.575Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:51.514Z InvocationID=95ba2e2f-deaf-4a7f-94f5-ba0469047be4 ResponseDesc=Internal Server Error 2021-07-13T00:18:11.866Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aa17aa79-e585-433f-884e-bbc0ba176f3e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:11.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:11.866Z InvocationID=f1b2d7b8-4d9c-4747-b5a7-788e31edaf60 2021-07-13T00:18:11.874Z [qtp817348612-46] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aa17aa79-e585-433f-884e-bbc0ba176f3e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:11.963Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=aa17aa79-e585-433f-884e-bbc0ba176f3e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:11.968Z [qtp817348612-46] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=aa17aa79-e585-433f-884e-bbc0ba176f3e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:11.968Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=aa17aa79-e585-433f-884e-bbc0ba176f3e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:11.969Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=aa17aa79-e585-433f-884e-bbc0ba176f3e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=103 EndTimestamp=2021-07-13T00:18:11.969Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:11.866Z InvocationID=d9080800-092b-4ec9-b9a0-8718ae935dd2 ResponseDesc=Internal Server Error 2021-07-13T00:18:12.458Z [qtp817348612-51] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a4fa55a3-ab70-4996-8322-5e82caa17cf8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:12.462Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a4fa55a3-ab70-4996-8322-5e82caa17cf8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:12.466Z [qtp817348612-51] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=a4fa55a3-ab70-4996-8322-5e82caa17cf8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:12.466Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a4fa55a3-ab70-4996-8322-5e82caa17cf8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:12.467Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=a4fa55a3-ab70-4996-8322-5e82caa17cf8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=10025 EndTimestamp=2021-07-13T00:18:12.467Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:02.442Z InvocationID=6b4fdfa5-e0e3-4db9-8167-3147de48eeec ResponseDesc=Internal Server Error 2021-07-13T00:18:12.471Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e6cd8522-fc55-4830-aaa7-dbcedef690cb ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 EntryTimestamp=2021-07-13T00:18:12.471Z ElapsedTime=0 EndTimestamp=2021-07-13T00:18:12.471Z InvocationID=74e8e54a-7ed2-4142-9d1a-61f9a10e0a0d PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:18:12.561Z [qtp817348612-62] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e6cd8522-fc55-4830-aaa7-dbcedef690cb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:12.566Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e6cd8522-fc55-4830-aaa7-dbcedef690cb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:12.570Z [qtp817348612-62] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=e6cd8522-fc55-4830-aaa7-dbcedef690cb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:12.570Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e6cd8522-fc55-4830-aaa7-dbcedef690cb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:12.571Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=e6cd8522-fc55-4830-aaa7-dbcedef690cb InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=100 EndTimestamp=2021-07-13T00:18:12.571Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:12.471Z InvocationID=14b23c78-ac1f-4e92-8ac4-6e2ef6ca4cd8 ResponseDesc=Internal Server Error 2021-07-13T00:18:12.969Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=29b116a9-6bdf-49c7-a7b3-a75e22af5296 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:12.969Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:12.969Z InvocationID=6693b961-fa87-45c7-ae19-a27b364e09bf 2021-07-13T00:18:13.060Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=29b116a9-6bdf-49c7-a7b3-a75e22af5296 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.064Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=29b116a9-6bdf-49c7-a7b3-a75e22af5296 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.069Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=29b116a9-6bdf-49c7-a7b3-a75e22af5296 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.069Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=29b116a9-6bdf-49c7-a7b3-a75e22af5296 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.069Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=29b116a9-6bdf-49c7-a7b3-a75e22af5296 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=100 EndTimestamp=2021-07-13T00:18:13.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:12.969Z InvocationID=81c9287d-84c8-4e2b-a8ce-a942882c710d ResponseDesc=Internal Server Error 2021-07-13T00:18:13.560Z [qtp817348612-63] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0d0489d6-b917-4fe6-9c92-f6877204dca0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.570Z [qtp817348612-63] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0d0489d6-b917-4fe6-9c92-f6877204dca0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.660Z [qtp817348612-63] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=0d0489d6-b917-4fe6-9c92-f6877204dca0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.660Z [qtp817348612-63] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0d0489d6-b917-4fe6-9c92-f6877204dca0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.661Z [qtp817348612-63] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=0d0489d6-b917-4fe6-9c92-f6877204dca0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=10161 EndTimestamp=2021-07-13T00:18:13.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:03.500Z InvocationID=1a7bc72c-0b26-44c6-a906-65c276f23fdc ResponseDesc=Internal Server Error 2021-07-13T00:18:13.960Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=545b4d71-dd63-48f8-94f3-d19c2ccb517d InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.966Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=545b4d71-dd63-48f8-94f3-d19c2ccb517d InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.970Z [qtp817348612-11] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=545b4d71-dd63-48f8-94f3-d19c2ccb517d InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.971Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=545b4d71-dd63-48f8-94f3-d19c2ccb517d InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:13.972Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=545b4d71-dd63-48f8-94f3-d19c2ccb517d InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=10096 EndTimestamp=2021-07-13T00:18:13.971Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:03.875Z InvocationID=5849fc86-183d-4e88-ba6a-b9ecebaf2690 ResponseDesc=Internal Server Error 2021-07-13T00:18:13.976Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f59f4c0-c4d8-4910-96fa-e34c52b3f775 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:13.976Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:13.976Z InvocationID=2c5e1411-1eac-4588-ba69-bbdd5b0b71da 2021-07-13T00:18:14.071Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f59f4c0-c4d8-4910-96fa-e34c52b3f775 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:14.160Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0f59f4c0-c4d8-4910-96fa-e34c52b3f775 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:14.166Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=0f59f4c0-c4d8-4910-96fa-e34c52b3f775 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:14.166Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0f59f4c0-c4d8-4910-96fa-e34c52b3f775 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:14.167Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=0f59f4c0-c4d8-4910-96fa-e34c52b3f775 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=191 EndTimestamp=2021-07-13T00:18:14.167Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:13.976Z InvocationID=111893e5-2f1c-4dec-ab40-96f9f9d485ae ResponseDesc=Internal Server Error 2021-07-13T00:18:14.263Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fc467196-603e-4c64-81d4-44659da53bff InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:14.262Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:14.262Z InvocationID=3cf3a0cc-734f-4559-909f-8461e4b751d1 2021-07-13T00:18:14.269Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fc467196-603e-4c64-81d4-44659da53bff InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:14.360Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=fc467196-603e-4c64-81d4-44659da53bff InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:14.365Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=fc467196-603e-4c64-81d4-44659da53bff InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:14.365Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=fc467196-603e-4c64-81d4-44659da53bff InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:14.366Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=fc467196-603e-4c64-81d4-44659da53bff InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=104 EndTimestamp=2021-07-13T00:18:14.366Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:14.262Z InvocationID=ab459d31-c47d-4ef4-979e-53af817c1b21 ResponseDesc=Internal Server Error 2021-07-13T00:18:15.462Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b6288e34-53a2-4e28-9503-e026f0ff106b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:15.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:15.462Z InvocationID=ede271d3-de0f-49ed-b1c9-ddf949f25363 2021-07-13T00:18:15.470Z [qtp817348612-51] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b6288e34-53a2-4e28-9503-e026f0ff106b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:15.558Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b6288e34-53a2-4e28-9503-e026f0ff106b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:15.562Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f5b33862-050f-4354-b16f-cc72fa99f9f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:15.564Z [qtp817348612-51] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=b6288e34-53a2-4e28-9503-e026f0ff106b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:15.564Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b6288e34-53a2-4e28-9503-e026f0ff106b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:15.565Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=b6288e34-53a2-4e28-9503-e026f0ff106b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=103 EndTimestamp=2021-07-13T00:18:15.565Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:15.462Z InvocationID=98cdbfce-c9e4-4268-b2de-4fad731d9e45 ResponseDesc=Internal Server Error 2021-07-13T00:18:15.568Z [qtp817348612-17] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=f5b33862-050f-4354-b16f-cc72fa99f9f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:15.568Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f5b33862-050f-4354-b16f-cc72fa99f9f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:15.569Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f5b33862-050f-4354-b16f-cc72fa99f9f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=20072 EndTimestamp=2021-07-13T00:18:15.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:17:55.497Z InvocationID=931015fa-bbed-48ea-b40d-f42ea15504ce ResponseDesc=Internal Server Error 2021-07-13T00:18:16.463Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=50cc74ac-6837-470f-81db-3b82a7deed8f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:16.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:16.462Z InvocationID=ea276fa1-d4f5-4e70-b4b6-ff0a6df3bf7b 2021-07-13T00:18:16.469Z [qtp817348612-62] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=50cc74ac-6837-470f-81db-3b82a7deed8f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:16.561Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=50cc74ac-6837-470f-81db-3b82a7deed8f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:16.566Z [qtp817348612-62] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=50cc74ac-6837-470f-81db-3b82a7deed8f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:16.566Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=50cc74ac-6837-470f-81db-3b82a7deed8f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:16.567Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=50cc74ac-6837-470f-81db-3b82a7deed8f InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=105 EndTimestamp=2021-07-13T00:18:16.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:16.462Z InvocationID=82189740-69ec-4935-b605-583f8d49a2dc ResponseDesc=Internal Server Error 2021-07-13T00:18:17.763Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d4f07f00-d3ae-405c-8d43-1d779a691283 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:17.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:17.763Z InvocationID=b745a4d5-025b-4470-b202-dc733f4f7058 2021-07-13T00:18:17.770Z [qtp817348612-64] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d4f07f00-d3ae-405c-8d43-1d779a691283 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:17.859Z [qtp817348612-64] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d4f07f00-d3ae-405c-8d43-1d779a691283 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:17.864Z [qtp817348612-64] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=d4f07f00-d3ae-405c-8d43-1d779a691283 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:17.864Z [qtp817348612-64] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d4f07f00-d3ae-405c-8d43-1d779a691283 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:17.865Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d4f07f00-d3ae-405c-8d43-1d779a691283 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=102 EndTimestamp=2021-07-13T00:18:17.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:17.763Z InvocationID=1ea4c826-c843-4e48-9c6a-5e84dd3d13fe ResponseDesc=Internal Server Error 2021-07-13T00:18:18.875Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e9a68dd4-91b6-4d16-9489-44852e4634cd InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:18.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:18.875Z InvocationID=36deef90-204d-4340-a38c-1f98192820ad 2021-07-13T00:18:18.960Z [qtp817348612-13] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e9a68dd4-91b6-4d16-9489-44852e4634cd InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:18.965Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e9a68dd4-91b6-4d16-9489-44852e4634cd InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:18.970Z [qtp817348612-13] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=e9a68dd4-91b6-4d16-9489-44852e4634cd InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:18.970Z [qtp817348612-13] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e9a68dd4-91b6-4d16-9489-44852e4634cd InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:18.970Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=e9a68dd4-91b6-4d16-9489-44852e4634cd InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=95 EndTimestamp=2021-07-13T00:18:18.970Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:18.875Z InvocationID=b775ae59-8210-4905-a7e6-f7b41181e788 ResponseDesc=Internal Server Error 2021-07-13T00:18:19.073Z [qtp817348612-63] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=128b9a6f-027a-41c6-aa23-3a39db995bd1 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:19.073Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:19.073Z InvocationID=b71afb1a-893b-4188-b9a0-afd1d72a9520 2021-07-13T00:18:19.164Z [qtp817348612-63] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=128b9a6f-027a-41c6-aa23-3a39db995bd1 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:19.169Z [qtp817348612-63] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=128b9a6f-027a-41c6-aa23-3a39db995bd1 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:19.174Z [qtp817348612-63] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=128b9a6f-027a-41c6-aa23-3a39db995bd1 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:19.174Z [qtp817348612-63] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=128b9a6f-027a-41c6-aa23-3a39db995bd1 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:19.175Z [qtp817348612-63] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=128b9a6f-027a-41c6-aa23-3a39db995bd1 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=102 EndTimestamp=2021-07-13T00:18:19.175Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:19.073Z InvocationID=6f43126b-283f-4367-98f5-db4e14b7145c ResponseDesc=Internal Server Error 2021-07-13T00:18:20.268Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fca11945-60dc-485a-b5e7-c5738557f017 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:20.268Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:20.268Z InvocationID=8b287bb0-0605-48c7-91cb-d00887fbe6ad 2021-07-13T00:18:20.275Z [qtp817348612-46] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fca11945-60dc-485a-b5e7-c5738557f017 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:20.364Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=fca11945-60dc-485a-b5e7-c5738557f017 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:20.370Z [qtp817348612-46] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=fca11945-60dc-485a-b5e7-c5738557f017 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:20.370Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=fca11945-60dc-485a-b5e7-c5738557f017 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:20.371Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=fca11945-60dc-485a-b5e7-c5738557f017 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=103 EndTimestamp=2021-07-13T00:18:20.371Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:20.268Z InvocationID=efa3e12b-63f9-4df3-866a-d1bff858504d ResponseDesc=Internal Server Error 2021-07-13T00:18:21.266Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b8cf5991-c6a6-4815-8277-146ae5c56d1e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:21.266Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:21.266Z InvocationID=144000dd-15c1-46af-8cf2-68774feedc83 2021-07-13T00:18:21.273Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b8cf5991-c6a6-4815-8277-146ae5c56d1e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:21.360Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b8cf5991-c6a6-4815-8277-146ae5c56d1e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:21.365Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=b8cf5991-c6a6-4815-8277-146ae5c56d1e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:21.365Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b8cf5991-c6a6-4815-8277-146ae5c56d1e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:21.366Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=b8cf5991-c6a6-4815-8277-146ae5c56d1e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=100 EndTimestamp=2021-07-13T00:18:21.366Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:21.266Z InvocationID=23937fb9-f9a5-45a5-bfe1-d37ccafef529 ResponseDesc=Internal Server Error 2021-07-13T00:18:22.469Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=54b2bb76-8356-46be-95ef-428b4959ac67 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:22.469Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:22.469Z InvocationID=7f2429ab-115b-4d3f-ad93-6aa460dc1c96 2021-07-13T00:18:22.564Z [qtp817348612-18] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=54b2bb76-8356-46be-95ef-428b4959ac67 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:22.657Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=54b2bb76-8356-46be-95ef-428b4959ac67 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:22.673Z [qtp817348612-18] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=54b2bb76-8356-46be-95ef-428b4959ac67 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:22.673Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=54b2bb76-8356-46be-95ef-428b4959ac67 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:22.674Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=54b2bb76-8356-46be-95ef-428b4959ac67 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=205 EndTimestamp=2021-07-13T00:18:22.674Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:22.469Z InvocationID=623333a3-9a53-4102-9f7f-522f2ee01074 ResponseDesc=Internal Server Error 2021-07-13T00:18:23.662Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=594ab876-9018-4957-b4dc-59702ef8fc7b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:23.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:23.661Z InvocationID=bd7fd3d5-3571-4f8a-917c-a1a1f956ff6c 2021-07-13T00:18:23.668Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=594ab876-9018-4957-b4dc-59702ef8fc7b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:23.757Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=594ab876-9018-4957-b4dc-59702ef8fc7b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:23.762Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=594ab876-9018-4957-b4dc-59702ef8fc7b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:23.762Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=594ab876-9018-4957-b4dc-59702ef8fc7b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:23.763Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=594ab876-9018-4957-b4dc-59702ef8fc7b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=102 EndTimestamp=2021-07-13T00:18:23.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:23.661Z InvocationID=2d6d54d9-cc49-473c-9ce0-615ef4206a84 ResponseDesc=Internal Server Error 2021-07-13T00:18:24.969Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=de7993c8-a353-4af4-8c07-2044ff723cdf InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:24.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:24.968Z InvocationID=cd16ac83-240d-42aa-b315-42ae223ea6ef 2021-07-13T00:18:25.060Z [qtp817348612-51] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=de7993c8-a353-4af4-8c07-2044ff723cdf InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:25.067Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=de7993c8-a353-4af4-8c07-2044ff723cdf InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:25.160Z [qtp817348612-51] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=de7993c8-a353-4af4-8c07-2044ff723cdf InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:25.160Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=de7993c8-a353-4af4-8c07-2044ff723cdf InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:25.161Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=de7993c8-a353-4af4-8c07-2044ff723cdf InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=193 EndTimestamp=2021-07-13T00:18:25.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:24.968Z InvocationID=a1d67336-81e4-4fa9-bfec-75f834527019 ResponseDesc=Internal Server Error 2021-07-13T00:18:26.169Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=76f5c164-f4e8-47fd-b6a4-0ed63cef2a15 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:26.169Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:26.169Z InvocationID=0058eb3f-7da5-426e-b123-eaf4aa2edef6 2021-07-13T00:18:26.175Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=76f5c164-f4e8-47fd-b6a4-0ed63cef2a15 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:26.260Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=76f5c164-f4e8-47fd-b6a4-0ed63cef2a15 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:26.266Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=76f5c164-f4e8-47fd-b6a4-0ed63cef2a15 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:26.266Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=76f5c164-f4e8-47fd-b6a4-0ed63cef2a15 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:26.267Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=76f5c164-f4e8-47fd-b6a4-0ed63cef2a15 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=98 EndTimestamp=2021-07-13T00:18:26.267Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:26.169Z InvocationID=c1e39a75-1760-4d0c-b1af-4ead3c1d9acd ResponseDesc=Internal Server Error 2021-07-13T00:18:27.260Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=620400c0-7abb-4ce2-ab67-5d4a4fcbbaf0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:27.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:27.259Z InvocationID=75e2f4eb-3830-4a15-9a91-46c03cb3406d 2021-07-13T00:18:27.266Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=620400c0-7abb-4ce2-ab67-5d4a4fcbbaf0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:27.271Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=620400c0-7abb-4ce2-ab67-5d4a4fcbbaf0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:27.360Z [qtp817348612-17] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=620400c0-7abb-4ce2-ab67-5d4a4fcbbaf0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:27.360Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=620400c0-7abb-4ce2-ab67-5d4a4fcbbaf0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:27.361Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=620400c0-7abb-4ce2-ab67-5d4a4fcbbaf0 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=102 EndTimestamp=2021-07-13T00:18:27.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:27.259Z InvocationID=917c8972-d547-4766-819c-69d68497dccf ResponseDesc=Internal Server Error 2021-07-13T00:18:28.170Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ebe4db04-bb98-4ef0-bc49-accdfad7690e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:28.170Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:28.170Z InvocationID=37f6624c-2adf-4215-a35a-b415f5df30d5 2021-07-13T00:18:28.262Z [qtp817348612-62] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ebe4db04-bb98-4ef0-bc49-accdfad7690e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:28.269Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ebe4db04-bb98-4ef0-bc49-accdfad7690e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:28.360Z [qtp817348612-62] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=ebe4db04-bb98-4ef0-bc49-accdfad7690e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:28.360Z [qtp817348612-62] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ebe4db04-bb98-4ef0-bc49-accdfad7690e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:28.361Z [qtp817348612-62] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=ebe4db04-bb98-4ef0-bc49-accdfad7690e InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=190 EndTimestamp=2021-07-13T00:18:28.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:28.170Z InvocationID=c5d8e976-3f94-4ec7-bda4-d3ffe24f0feb ResponseDesc=Internal Server Error 2021-07-13T00:18:28.873Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8051fe0b-51a7-48d7-ae96-b5d05d2d0f10 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:28.873Z InvocationID=cc95ca35-6795-4d63-985a-fb0bf3497d99 2021-07-13T00:18:28.962Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8051fe0b-51a7-48d7-ae96-b5d05d2d0f10 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:28.966Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=8051fe0b-51a7-48d7-ae96-b5d05d2d0f10 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:29.060Z [qtp817348612-54] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=8051fe0b-51a7-48d7-ae96-b5d05d2d0f10 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:29.060Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=8051fe0b-51a7-48d7-ae96-b5d05d2d0f10 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:29.061Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=8051fe0b-51a7-48d7-ae96-b5d05d2d0f10 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=188 EndTimestamp=2021-07-13T00:18:29.061Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:28.873Z InvocationID=15a6596c-37f7-485e-9e7c-2104a025bbc0 ResponseDesc=Internal Server Error 2021-07-13T00:18:29.470Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=11d4cf09-64b4-4981-b13c-031dee5a446a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:29.469Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:29.469Z InvocationID=134ea941-96f1-44b2-93d7-3bf5c1d6c161 2021-07-13T00:18:29.562Z [qtp817348612-64] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=11d4cf09-64b4-4981-b13c-031dee5a446a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:29.569Z [qtp817348612-64] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=11d4cf09-64b4-4981-b13c-031dee5a446a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:29.664Z [qtp817348612-64] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=11d4cf09-64b4-4981-b13c-031dee5a446a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:29.664Z [qtp817348612-64] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=11d4cf09-64b4-4981-b13c-031dee5a446a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:29.665Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=11d4cf09-64b4-4981-b13c-031dee5a446a InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=196 EndTimestamp=2021-07-13T00:18:29.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:29.469Z InvocationID=829bbc70-6ab3-4956-8ae0-7857b8c3522d ResponseDesc=Internal Server Error 2021-07-13T00:18:31.067Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e18e4a3-94f3-4b9e-8cb4-766d442bbe53 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:31.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:31.066Z InvocationID=1ca53a15-c24f-455f-a31d-dbb5830be123 2021-07-13T00:18:31.073Z [qtp817348612-65] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e18e4a3-94f3-4b9e-8cb4-766d442bbe53 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:31.170Z [qtp817348612-65] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5e18e4a3-94f3-4b9e-8cb4-766d442bbe53 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:31.261Z [qtp817348612-65] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=5e18e4a3-94f3-4b9e-8cb4-766d442bbe53 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:31.261Z [qtp817348612-65] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5e18e4a3-94f3-4b9e-8cb4-766d442bbe53 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:31.263Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=5e18e4a3-94f3-4b9e-8cb4-766d442bbe53 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=196 EndTimestamp=2021-07-13T00:18:31.262Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:31.066Z InvocationID=abde6341-0e57-4e10-b6a3-b7520c70e603 ResponseDesc=Internal Server Error 2021-07-13T00:18:32.571Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d53c1386-a6c5-49f9-92e8-540b36d9d9a8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:32.571Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:32.571Z InvocationID=f78932d8-7124-4eb3-be91-4621c6ca2efb 2021-07-13T00:18:32.662Z [qtp817348612-46] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d53c1386-a6c5-49f9-92e8-540b36d9d9a8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:32.669Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d53c1386-a6c5-49f9-92e8-540b36d9d9a8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:32.760Z [qtp817348612-46] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=d53c1386-a6c5-49f9-92e8-540b36d9d9a8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:32.760Z [qtp817348612-46] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d53c1386-a6c5-49f9-92e8-540b36d9d9a8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:32.761Z [qtp817348612-46] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d53c1386-a6c5-49f9-92e8-540b36d9d9a8 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=190 EndTimestamp=2021-07-13T00:18:32.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:32.571Z InvocationID=50c9bce5-6a29-4dc5-a2ac-28b20955009b ResponseDesc=Internal Server Error 2021-07-13T00:18:34.273Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ebde9bf0-d7b9-4214-98df-67e74cfbe308 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:34.273Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:34.273Z InvocationID=e12ece3f-55fc-4e1f-bcf4-af8dd58cbab0 2021-07-13T00:18:34.363Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ebde9bf0-d7b9-4214-98df-67e74cfbe308 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:34.369Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ebde9bf0-d7b9-4214-98df-67e74cfbe308 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:34.373Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=ebde9bf0-d7b9-4214-98df-67e74cfbe308 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:34.374Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ebde9bf0-d7b9-4214-98df-67e74cfbe308 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:34.375Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=ebde9bf0-d7b9-4214-98df-67e74cfbe308 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=101 EndTimestamp=2021-07-13T00:18:34.374Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:34.273Z InvocationID=7e1c2448-523f-4959-ac9a-ef2674688319 ResponseDesc=Internal Server Error 2021-07-13T00:18:35.366Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2f49f82b-0dd7-40d5-8d5d-483ab94392ac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:35.366Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:35.366Z InvocationID=e89d2605-8aa8-4b4f-b175-3dfe267b557a 2021-07-13T00:18:35.373Z [qtp817348612-18] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2f49f82b-0dd7-40d5-8d5d-483ab94392ac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:35.461Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=2f49f82b-0dd7-40d5-8d5d-483ab94392ac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:35.466Z [qtp817348612-18] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=2f49f82b-0dd7-40d5-8d5d-483ab94392ac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:35.466Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=2f49f82b-0dd7-40d5-8d5d-483ab94392ac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:35.467Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=2f49f82b-0dd7-40d5-8d5d-483ab94392ac InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=101 EndTimestamp=2021-07-13T00:18:35.467Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:35.366Z InvocationID=eca1e6a1-0ad2-421d-8904-4edbfc10d68c ResponseDesc=Internal Server Error 2021-07-13T00:18:36.569Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=836a1b4a-01dd-4c28-916d-596f4522bd0b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:36.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:36.569Z InvocationID=e7f859f6-b18e-4f33-ba06-22875c1a76df 2021-07-13T00:18:36.667Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=836a1b4a-01dd-4c28-916d-596f4522bd0b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:36.857Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=836a1b4a-01dd-4c28-916d-596f4522bd0b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:36.864Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=836a1b4a-01dd-4c28-916d-596f4522bd0b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:36.864Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=836a1b4a-01dd-4c28-916d-596f4522bd0b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:36.865Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=836a1b4a-01dd-4c28-916d-596f4522bd0b InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=296 EndTimestamp=2021-07-13T00:18:36.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:36.569Z InvocationID=264bc641-680a-4b57-8a41-c46eb5e52457 ResponseDesc=Internal Server Error 2021-07-13T00:18:38.071Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3ffa5e89-e376-435e-b07d-c41c214e29f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:38.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:38.071Z InvocationID=a451a9c6-7780-49fb-a961-2707ba485bf2 2021-07-13T00:18:38.162Z [qtp817348612-51] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3ffa5e89-e376-435e-b07d-c41c214e29f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:38.167Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3ffa5e89-e376-435e-b07d-c41c214e29f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:38.172Z [qtp817348612-51] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=3ffa5e89-e376-435e-b07d-c41c214e29f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:38.172Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3ffa5e89-e376-435e-b07d-c41c214e29f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:38.173Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=3ffa5e89-e376-435e-b07d-c41c214e29f6 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=102 EndTimestamp=2021-07-13T00:18:38.173Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:38.071Z InvocationID=0a8b9b76-768e-4f6b-b537-1bec737bc04d ResponseDesc=Internal Server Error 2021-07-13T00:18:38.875Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2f11a577-cebe-48f2-acf4-3b9878caef21 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:38.874Z InvocationID=b922aea3-aa9c-43b8-ba62-66589ca70c9c 2021-07-13T00:18:38.964Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2f11a577-cebe-48f2-acf4-3b9878caef21 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:38.970Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=2f11a577-cebe-48f2-acf4-3b9878caef21 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:39.060Z [qtp817348612-11] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=2f11a577-cebe-48f2-acf4-3b9878caef21 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:39.060Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=2f11a577-cebe-48f2-acf4-3b9878caef21 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:39.061Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=2f11a577-cebe-48f2-acf4-3b9878caef21 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=187 EndTimestamp=2021-07-13T00:18:39.061Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:38.874Z InvocationID=d368791f-e9e9-4951-a1ac-9fdd6670ead8 ResponseDesc=Internal Server Error 2021-07-13T00:18:39.362Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0866bbba-e712-41ec-b15f-6a087e9fb52c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:39.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:39.362Z InvocationID=32517d1c-dc06-41f1-8167-ca1f89ad6316 2021-07-13T00:18:39.368Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0866bbba-e712-41ec-b15f-6a087e9fb52c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:39.562Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0866bbba-e712-41ec-b15f-6a087e9fb52c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:39.567Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=0866bbba-e712-41ec-b15f-6a087e9fb52c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:39.567Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0866bbba-e712-41ec-b15f-6a087e9fb52c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:39.568Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=0866bbba-e712-41ec-b15f-6a087e9fb52c InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=206 EndTimestamp=2021-07-13T00:18:39.568Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:39.362Z InvocationID=d8f1a44d-1821-465a-b675-f26d77538473 ResponseDesc=Internal Server Error 2021-07-13T00:18:40.670Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9e8def2a-03a8-4623-9936-82e21514b997 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:40.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:40.670Z InvocationID=28a8d461-1de4-4ae0-bacc-1c135e3d6864 2021-07-13T00:18:40.766Z [qtp817348612-54] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9e8def2a-03a8-4623-9936-82e21514b997 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:40.865Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9e8def2a-03a8-4623-9936-82e21514b997 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:40.960Z [qtp817348612-54] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=9e8def2a-03a8-4623-9936-82e21514b997 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:40.960Z [qtp817348612-54] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9e8def2a-03a8-4623-9936-82e21514b997 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:40.961Z [qtp817348612-54] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=9e8def2a-03a8-4623-9936-82e21514b997 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=290 EndTimestamp=2021-07-13T00:18:40.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:40.670Z InvocationID=a6dec069-e87d-45c6-bfcf-2e239c7d3e5d ResponseDesc=Internal Server Error 2021-07-13T00:18:42.065Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dc9194e3-f473-4332-8a48-08cf23e9f747 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=0 EndTimestamp=2021-07-13T00:18:42.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:42.065Z InvocationID=b479e8a6-517d-4e90-8021-82e3a3381534 2021-07-13T00:18:42.076Z [qtp817348612-64] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dc9194e3-f473-4332-8a48-08cf23e9f747 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:42.160Z [qtp817348612-64] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=dc9194e3-f473-4332-8a48-08cf23e9f747 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:42.167Z [qtp817348612-64] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=dc9194e3-f473-4332-8a48-08cf23e9f747 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:42.167Z [qtp817348612-64] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=dc9194e3-f473-4332-8a48-08cf23e9f747 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:18:42.168Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=dc9194e3-f473-4332-8a48-08cf23e9f747 InstanceID=58aeaa2f-da99-4475-9781-def6222fcb09 ElapsedTime=102 EndTimestamp=2021-07-13T00:18:42.167Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:18:42.065Z InvocationID=3f9bbf81-8093-4f98-bdb5-ea3ee7e4b765 ResponseDesc=Internal Server Error 2021-07-13T00:19:00.314Z [main] INFO o.s.web.context.ContextLoader Root WebApplicationContext: initialization started 2021-07-13T00:19:01.162Z [main] INFO o.h.validator.internal.util.Version HV000001: Hibernate Validator 5.3.6.Final 2021-07-13T00:19:01.445Z [main] INFO com.datastax.driver.core DataStax Java driver 3.8.0 for Apache Cassandra 2021-07-13T00:19:01.451Z [main] INFO c.d.driver.core.GuavaCompatibility Detected Guava >= 19 in the classpath, using modern compatibility layer 2021-07-13T00:19:01.465Z [main] INFO o.o.c.n.i.c.CassandraSessionFactory localDatacenter was provided, setting Cassndra client to use datacenter: Pod as local. 2021-07-13T00:19:01.473Z [main] INFO c.d.driver.core.SystemProperties com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false 2021-07-13T00:19:01.473Z [main] INFO c.datastax.driver.core.ClockFactory Using java.lang.System clock to generate timestamps. 2021-07-13T00:19:01.564Z [main] INFO o.o.c.n.i.c.CassandraSessionFactory Cassandra client created hosts: [cassandra.onap] port: 9042 SSL enabled: false reconnectTimeout 2021-07-13T00:19:01.642Z [main] INFO com.datastax.driver.core.NettyUtil Did not find Netty's native epoll transport in the classpath, defaulting to NIO. 2021-07-13T00:19:14.800Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-07-13T00:19:14.804Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.219.208:9042 added 2021-07-13T00:19:14.804Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.211.142:9042 added 2021-07-13T00:19:16.390Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T00:19:16.481Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T00:19:16.568Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T00:19:16.571Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.user_candidate_version <-> org.openecomp.sdc.versioning.dao.types.UserCandidateVersion] because it collides with previously registered codec MappedUDTCodec [dox.user_candidate_version <-> org.openecomp.sdc.versioning.dao.types.UserCandidateVersion] 2021-07-13T00:19:17.236Z [main] INFO o.o.c.e.i.ExternalTestingManagerImpl loaded external testing config {"client":{"enabled":true},"endpoints":["vtp,VTP,true,http://refrepo:8702/onapapi/vnfsdk-marketplace,onap.*","repository,Repository,false,,.*"]} 2021-07-13T00:19:17.241Z [main] INFO o.o.c.e.i.ExternalTestingManagerImpl processed external testing config [{"enabled":true,"title":"VTP","url":"http://refrepo:8702/onapapi/vnfsdk-marketplace","id":"vtp","apiKey":null,"scenarioFilter":"onap.*"},{"enabled":false,"title":"Repository","url":"","id":"repository","apiKey":null,"scenarioFilter":".*"}] 2021-07-13T00:19:18.096Z [main] INFO org.apache.cxf.endpoint.ServerImpl Setting the server's publish address to be / 2021-07-13T00:19:18.189Z [main] INFO o.s.web.context.ContextLoader Root WebApplicationContext initialized in 17872 ms 2021-07-13T00:19:20.613Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T00:19:20.728Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T00:19:20.747Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T00:19:21.073Z [main] INFO o.s.web.servlet.DispatcherServlet Initializing Servlet 'spring-mapper' 2021-07-13T00:19:21.242Z [main] INFO o.s.web.servlet.DispatcherServlet Completed initialization in 168 ms 2021-07-13T00:19:21.524Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:21.517Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:21.517Z InvocationID=e0071608-48a3-4790-9142-6e1ba4955913 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:21.524Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7d520ff6-48e0-45fc-8be9-f26a9f62bf9a ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:21.517Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:21.517Z InvocationID=edde3b3b-971c-45ad-b600-1279fd48285d PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:21.954Z [qtp817348612-20] INFO c.d.driver.core.SystemProperties RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false 2021-07-13T00:19:21.954Z [qtp817348612-20] INFO c.datastax.driver.core.ClockFactory RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Using java.lang.System clock to generate timestamps. 2021-07-13T00:19:22.924Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1ece77f8-6119-415d-b9e2-b0847bd52205 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:22.924Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:22.924Z InvocationID=6cd8998d-228d-4f8f-aa61-5f278e9d0b8e PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:27.028Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=54a022ff-b23f-4cf2-8e1f-7a924a23eb78 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:27.027Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:27.027Z InvocationID=1a66ed18-1ffb-4258-be40-8c4ad02a9904 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:31.120Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=155137df-e9cc-4822-913e-04954ef559b7 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:31.119Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:31.119Z InvocationID=7eba565e-04b5-4dc9-abf8-a7f06749d6f6 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:32.334Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=30fa3fa8-56e1-4a7d-bf3e-c55d3082163a ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:32.334Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:32.334Z InvocationID=2d81fcd6-c989-4152-8291-51983ccdd82b PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:35.030Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b537f213-a04e-48c9-a2a5-8d44bc4ecd6e ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:35.029Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:35.029Z InvocationID=1d2d1230-ce0e-42db-9fc0-dacbfd8bcad2 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:35.326Z [qtp817348612-20] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-07-13T00:19:35.327Z [qtp817348612-20] INFO com.datastax.driver.core.Cluster RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.219.208:9042 added 2021-07-13T00:19:35.327Z [qtp817348612-20] INFO com.datastax.driver.core.Cluster RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.211.142:9042 added 2021-07-13T00:19:37.267Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7d520ff6-48e0-45fc-8be9-f26a9f62bf9a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:19:37.269Z [qtp817348612-48] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=54a022ff-b23f-4cf2-8e1f-7a924a23eb78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:19:37.362Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='UPDATE version SET modification_time=? WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T00:19:37.362Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id, base_version_id, creation_time, modification_time FROM version WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T00:19:37.363Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id FROM version LIMIT 1' 2021-07-13T00:19:37.364Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b537f213-a04e-48c9-a2a5-8d44bc4ecd6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.365Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='DELETE FROM version WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T00:19:37.366Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id, base_version_id, creation_time, modification_time FROM version WHERE space=? AND item_id=?' 2021-07-13T00:19:37.367Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='INSERT INTO version (space, item_id, version_id, base_version_id, creation_time, modification_time) VALUES (?, ?, ?, ?, ?, ?)' 2021-07-13T00:19:37.370Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id FROM version LIMIT 1' 2021-07-13T00:19:37.370Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='INSERT INTO version (space, item_id, version_id, base_version_id, creation_time, modification_time) VALUES (?, ?, ?, ?, ?, ?)' 2021-07-13T00:19:37.370Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='DELETE FROM version WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T00:19:37.458Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='UPDATE version SET modification_time=? WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T00:19:37.458Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id, base_version_id, creation_time, modification_time FROM version WHERE space=? AND item_id=?' 2021-07-13T00:19:37.460Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id, base_version_id, creation_time, modification_time FROM version WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T00:19:37.465Z [qtp817348612-47] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1ece77f8-6119-415d-b9e2-b0847bd52205 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:19:37.468Z [qtp817348612-51] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=155137df-e9cc-4822-913e-04954ef559b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:19:37.477Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7d520ff6-48e0-45fc-8be9-f26a9f62bf9a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:19:37.559Z [qtp817348612-14] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=30fa3fa8-56e1-4a7d-bf3e-c55d3082163a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:19:37.562Z [qtp817348612-48] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=54a022ff-b23f-4cf2-8e1f-7a924a23eb78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:19:37.564Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1ece77f8-6119-415d-b9e2-b0847bd52205 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:19:37.569Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=7d520ff6-48e0-45fc-8be9-f26a9f62bf9a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.569Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7d520ff6-48e0-45fc-8be9-f26a9f62bf9a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.570Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=155137df-e9cc-4822-913e-04954ef559b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.578Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=30fa3fa8-56e1-4a7d-bf3e-c55d3082163a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.580Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b537f213-a04e-48c9-a2a5-8d44bc4ecd6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.588Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=7d520ff6-48e0-45fc-8be9-f26a9f62bf9a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=16069 EndTimestamp=2021-07-13T00:19:37.586Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:21.517Z InvocationID=86386edd-b674-4cf4-9871-278c7e590a19 ResponseDesc=Internal Server Error 2021-07-13T00:19:37.662Z [qtp817348612-51] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=155137df-e9cc-4822-913e-04954ef559b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:19:37.662Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=155137df-e9cc-4822-913e-04954ef559b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:19:37.666Z [qtp817348612-48] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=54a022ff-b23f-4cf2-8e1f-7a924a23eb78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.666Z [qtp817348612-48] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=54a022ff-b23f-4cf2-8e1f-7a924a23eb78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.666Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=155137df-e9cc-4822-913e-04954ef559b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=6547 EndTimestamp=2021-07-13T00:19:37.666Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:31.119Z InvocationID=852bf452-6474-4179-a1d3-efe0e5be7682 ResponseDesc=Internal Server Error 2021-07-13T00:19:37.666Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=54a022ff-b23f-4cf2-8e1f-7a924a23eb78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=10639 EndTimestamp=2021-07-13T00:19:37.666Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:27.027Z InvocationID=453617c7-ad24-4001-ab08-9400e6ad1695 ResponseDesc=Internal Server Error 2021-07-13T00:19:37.669Z [qtp817348612-14] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=30fa3fa8-56e1-4a7d-bf3e-c55d3082163a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:19:37.669Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=b537f213-a04e-48c9-a2a5-8d44bc4ecd6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.669Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=30fa3fa8-56e1-4a7d-bf3e-c55d3082163a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T00:19:37.669Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=b537f213-a04e-48c9-a2a5-8d44bc4ecd6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.670Z [qtp817348612-47] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=1ece77f8-6119-415d-b9e2-b0847bd52205 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.671Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1ece77f8-6119-415d-b9e2-b0847bd52205 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:37.671Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=30fa3fa8-56e1-4a7d-bf3e-c55d3082163a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5337 EndTimestamp=2021-07-13T00:19:37.671Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:32.334Z InvocationID=ecbed22d-47c1-4202-964e-e29e73b1627e ResponseDesc=Internal Server Error 2021-07-13T00:19:37.673Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=b537f213-a04e-48c9-a2a5-8d44bc4ecd6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2642 EndTimestamp=2021-07-13T00:19:37.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:35.029Z InvocationID=85ef2114-c361-44a9-83f7-ebf5d5237975 ResponseDesc=Internal Server Error 2021-07-13T00:19:37.673Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=1ece77f8-6119-415d-b9e2-b0847bd52205 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=14747 EndTimestamp=2021-07-13T00:19:37.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:22.924Z InvocationID=f15dd2cf-dd74-4845-9a08-95780ea8fd01 ResponseDesc=Internal Server Error 2021-07-13T00:19:38.067Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:19:38.165Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:38.173Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:38.173Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:38.174Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=aae4b438-9b83-48b8-acca-409fe8f006a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=16657 EndTimestamp=2021-07-13T00:19:38.174Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:21.517Z InvocationID=21c3a8ef-2e35-49d3-98d7-ed266a0f8f26 ResponseDesc=Internal Server Error 2021-07-13T00:19:38.579Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f9494214-740a-4dbf-9e6a-3cb290e30167 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:38.579Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:38.579Z InvocationID=36c67192-ec1d-4f7f-b6ab-e74f9dcee668 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:38.666Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f9494214-740a-4dbf-9e6a-3cb290e30167 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:38.674Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f9494214-740a-4dbf-9e6a-3cb290e30167 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:38.761Z [qtp817348612-11] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=f9494214-740a-4dbf-9e6a-3cb290e30167 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:38.761Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f9494214-740a-4dbf-9e6a-3cb290e30167 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:38.762Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f9494214-740a-4dbf-9e6a-3cb290e30167 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=183 EndTimestamp=2021-07-13T00:19:38.762Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:38.579Z InvocationID=bdf07242-50cb-444d-b2f8-1abf6f9c291e ResponseDesc=Internal Server Error 2021-07-13T00:19:40.064Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=09296b58-2a1f-415c-a033-a08b6795b28a ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:40.063Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:40.063Z InvocationID=009a8c18-dcb3-425a-bd11-5826800dbaa3 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:40.158Z [qtp817348612-56] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=09296b58-2a1f-415c-a033-a08b6795b28a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:40.262Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=09296b58-2a1f-415c-a033-a08b6795b28a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:40.270Z [qtp817348612-56] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=09296b58-2a1f-415c-a033-a08b6795b28a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:40.271Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=09296b58-2a1f-415c-a033-a08b6795b28a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:40.273Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=09296b58-2a1f-415c-a033-a08b6795b28a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=209 EndTimestamp=2021-07-13T00:19:40.272Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:40.063Z InvocationID=16c319aa-e0bc-4461-86f2-a97b8204d004 ResponseDesc=Internal Server Error 2021-07-13T00:19:41.475Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=75363e10-2c79-436f-a00a-34095c4f72b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:41.475Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:41.475Z InvocationID=c2f91707-5e15-4ab6-91c1-32f39cbda733 2021-07-13T00:19:41.564Z [qtp817348612-14] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=75363e10-2c79-436f-a00a-34095c4f72b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:41.660Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=75363e10-2c79-436f-a00a-34095c4f72b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:41.667Z [qtp817348612-14] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=75363e10-2c79-436f-a00a-34095c4f72b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:41.667Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=75363e10-2c79-436f-a00a-34095c4f72b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:41.668Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=75363e10-2c79-436f-a00a-34095c4f72b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=193 EndTimestamp=2021-07-13T00:19:41.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:41.475Z InvocationID=ee7d0102-143e-48ac-a8c1-39617146b739 ResponseDesc=Internal Server Error 2021-07-13T00:19:42.331Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dea79c6a-c5de-4f3f-9bc7-78ed7b8c60c1 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:42.331Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:42.331Z InvocationID=35efa6cc-3785-4596-a4f9-dad22a00a57b PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:42.365Z [qtp817348612-18] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dea79c6a-c5de-4f3f-9bc7-78ed7b8c60c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:42.460Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=dea79c6a-c5de-4f3f-9bc7-78ed7b8c60c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:42.564Z [qtp817348612-18] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=dea79c6a-c5de-4f3f-9bc7-78ed7b8c60c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:42.565Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=dea79c6a-c5de-4f3f-9bc7-78ed7b8c60c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:42.567Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=dea79c6a-c5de-4f3f-9bc7-78ed7b8c60c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=235 EndTimestamp=2021-07-13T00:19:42.566Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:42.331Z InvocationID=89ec8a9d-4e09-4386-a5f9-c85ba6af5f64 ResponseDesc=Internal Server Error 2021-07-13T00:19:42.866Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=05c121d1-41e2-4fbf-8adc-264156de718d ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:42.865Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:42.865Z InvocationID=73003033-d802-42c6-be18-a99f50cfe9be PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:42.961Z [qtp817348612-49] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=05c121d1-41e2-4fbf-8adc-264156de718d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:42.971Z [qtp817348612-49] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=05c121d1-41e2-4fbf-8adc-264156de718d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:43.064Z [qtp817348612-49] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=05c121d1-41e2-4fbf-8adc-264156de718d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:43.064Z [qtp817348612-49] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=05c121d1-41e2-4fbf-8adc-264156de718d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:43.065Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=05c121d1-41e2-4fbf-8adc-264156de718d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=200 EndTimestamp=2021-07-13T00:19:43.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:42.865Z InvocationID=9ea772a7-0bc1-4706-af56-8f511bfd64b1 ResponseDesc=Internal Server Error 2021-07-13T00:19:44.064Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7f41dc8e-df59-4831-82e7-51256a41122e ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:44.064Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:44.064Z InvocationID=257689ac-8409-4051-993b-879a99387e69 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:44.073Z [qtp817348612-16] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7f41dc8e-df59-4831-82e7-51256a41122e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:44.163Z [qtp817348612-16] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7f41dc8e-df59-4831-82e7-51256a41122e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:44.168Z [qtp817348612-16] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=7f41dc8e-df59-4831-82e7-51256a41122e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:44.168Z [qtp817348612-16] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7f41dc8e-df59-4831-82e7-51256a41122e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:44.169Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=7f41dc8e-df59-4831-82e7-51256a41122e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=105 EndTimestamp=2021-07-13T00:19:44.169Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:44.064Z InvocationID=09b1de0b-9888-4066-a225-91cb36bc4665 ResponseDesc=Internal Server Error 2021-07-13T00:19:45.462Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9c5c0df8-3064-4b2c-a7e5-6e572fa0d9a1 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:19:45.461Z ElapsedTime=0 EndTimestamp=2021-07-13T00:19:45.461Z InvocationID=f6dfc690-574e-4dca-965f-a83d73e76c78 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:19:45.470Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9c5c0df8-3064-4b2c-a7e5-6e572fa0d9a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:45.560Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9c5c0df8-3064-4b2c-a7e5-6e572fa0d9a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:45.566Z [qtp817348612-17] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=9c5c0df8-3064-4b2c-a7e5-6e572fa0d9a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:45.566Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9c5c0df8-3064-4b2c-a7e5-6e572fa0d9a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:45.567Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=9c5c0df8-3064-4b2c-a7e5-6e572fa0d9a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=106 EndTimestamp=2021-07-13T00:19:45.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:45.461Z InvocationID=fe5d6e14-167d-4634-b21b-7dab38ac9417 ResponseDesc=Internal Server Error 2021-07-13T00:19:46.669Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f02ce196-1940-4522-9a2d-153222cdd8d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:46.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:46.668Z InvocationID=2a66a5c4-9bbb-4be9-82d9-5a346569c19b 2021-07-13T00:19:46.760Z [qtp817348612-47] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f02ce196-1940-4522-9a2d-153222cdd8d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:46.767Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f02ce196-1940-4522-9a2d-153222cdd8d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:46.860Z [qtp817348612-47] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=f02ce196-1940-4522-9a2d-153222cdd8d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:46.860Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f02ce196-1940-4522-9a2d-153222cdd8d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:46.862Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f02ce196-1940-4522-9a2d-153222cdd8d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=193 EndTimestamp=2021-07-13T00:19:46.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:46.668Z InvocationID=2de7b085-9581-494e-b8f4-60fa2133ff3d ResponseDesc=Internal Server Error 2021-07-13T00:19:48.266Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f0e42534-5c09-4e40-b128-6d340309abd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:48.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:48.265Z InvocationID=02ac8bb0-9c0a-425c-b2c2-eedd0d7a6747 2021-07-13T00:19:48.275Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f0e42534-5c09-4e40-b128-6d340309abd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:48.282Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f0e42534-5c09-4e40-b128-6d340309abd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:48.362Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=f0e42534-5c09-4e40-b128-6d340309abd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:48.362Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f0e42534-5c09-4e40-b128-6d340309abd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:48.364Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f0e42534-5c09-4e40-b128-6d340309abd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=98 EndTimestamp=2021-07-13T00:19:48.363Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:48.265Z InvocationID=7441e29f-1743-4eb0-a1d7-5a5b32df9478 ResponseDesc=Internal Server Error 2021-07-13T00:19:49.173Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0cb1a786-aae0-4db9-9345-dcec50bbf825 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:49.173Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:49.173Z InvocationID=264c4f21-b2e8-42be-b398-312302205565 2021-07-13T00:19:49.263Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0cb1a786-aae0-4db9-9345-dcec50bbf825 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:49.268Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0cb1a786-aae0-4db9-9345-dcec50bbf825 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:49.274Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=0cb1a786-aae0-4db9-9345-dcec50bbf825 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:49.274Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0cb1a786-aae0-4db9-9345-dcec50bbf825 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:49.275Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=0cb1a786-aae0-4db9-9345-dcec50bbf825 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=102 EndTimestamp=2021-07-13T00:19:49.275Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:49.173Z InvocationID=b3fd3755-246f-4492-95f9-61ed70cfa757 ResponseDesc=Internal Server Error 2021-07-13T00:19:50.372Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6c144b83-74e6-48f3-a8cd-e6287dfeaab4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:50.371Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:50.371Z InvocationID=0bd4e6fd-135e-4bec-962a-062cccc08c3a 2021-07-13T00:19:50.463Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6c144b83-74e6-48f3-a8cd-e6287dfeaab4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:50.468Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=6c144b83-74e6-48f3-a8cd-e6287dfeaab4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:50.560Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=6c144b83-74e6-48f3-a8cd-e6287dfeaab4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:50.560Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=6c144b83-74e6-48f3-a8cd-e6287dfeaab4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:50.561Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=6c144b83-74e6-48f3-a8cd-e6287dfeaab4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=189 EndTimestamp=2021-07-13T00:19:50.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:50.371Z InvocationID=5dbe576e-b885-46ac-b7ac-fdb67efea6e7 ResponseDesc=Internal Server Error 2021-07-13T00:19:51.665Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=277ca672-91d1-4c43-b36e-2f36f8b5267d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:51.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:51.665Z InvocationID=a54e41c6-ecd1-4470-aa85-053ffd12b6c9 2021-07-13T00:19:51.760Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=277ca672-91d1-4c43-b36e-2f36f8b5267d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:51.764Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=277ca672-91d1-4c43-b36e-2f36f8b5267d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:51.769Z [qtp817348612-11] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=277ca672-91d1-4c43-b36e-2f36f8b5267d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:51.769Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=277ca672-91d1-4c43-b36e-2f36f8b5267d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:51.770Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=277ca672-91d1-4c43-b36e-2f36f8b5267d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=105 EndTimestamp=2021-07-13T00:19:51.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:51.665Z InvocationID=132e9925-a301-466c-9cc9-8578a706d86b ResponseDesc=Internal Server Error 2021-07-13T00:19:52.330Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a62e233f-e3e1-403d-b2f7-deef7eca665b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:52.330Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:52.330Z InvocationID=f27446d9-b267-441d-bcfa-0ddfc84e8448 2021-07-13T00:19:52.560Z [qtp817348612-48] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a62e233f-e3e1-403d-b2f7-deef7eca665b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:52.564Z [qtp817348612-48] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a62e233f-e3e1-403d-b2f7-deef7eca665b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:52.660Z [qtp817348612-48] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=a62e233f-e3e1-403d-b2f7-deef7eca665b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:52.660Z [qtp817348612-48] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a62e233f-e3e1-403d-b2f7-deef7eca665b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:52.661Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=a62e233f-e3e1-403d-b2f7-deef7eca665b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=330 EndTimestamp=2021-07-13T00:19:52.660Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:52.330Z InvocationID=8b0694c1-b536-4913-8980-8090377805da ResponseDesc=Internal Server Error 2021-07-13T00:19:52.966Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e1e77b9b-c82d-429d-a6d8-e295cbfa7448 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:52.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:52.966Z InvocationID=e12fb2bd-ef06-4b8b-abe1-4f73f1459e87 2021-07-13T00:19:52.972Z [qtp817348612-56] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e1e77b9b-c82d-429d-a6d8-e295cbfa7448 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:53.061Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e1e77b9b-c82d-429d-a6d8-e295cbfa7448 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:53.066Z [qtp817348612-56] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=e1e77b9b-c82d-429d-a6d8-e295cbfa7448 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:53.066Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e1e77b9b-c82d-429d-a6d8-e295cbfa7448 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:53.067Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=e1e77b9b-c82d-429d-a6d8-e295cbfa7448 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=101 EndTimestamp=2021-07-13T00:19:53.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:52.966Z InvocationID=4c92d3fb-7cb3-4ebf-bc21-2cfe01ab0eaa ResponseDesc=Internal Server Error 2021-07-13T00:19:54.073Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fdc52f95-df28-4bfa-b2d6-ed5c384ddd5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:54.073Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:54.073Z InvocationID=48e48029-aa30-49f2-a42b-1ff6a27e12ad 2021-07-13T00:19:54.160Z [qtp817348612-18] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fdc52f95-df28-4bfa-b2d6-ed5c384ddd5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:54.166Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=fdc52f95-df28-4bfa-b2d6-ed5c384ddd5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:54.172Z [qtp817348612-18] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=fdc52f95-df28-4bfa-b2d6-ed5c384ddd5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:54.172Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=fdc52f95-df28-4bfa-b2d6-ed5c384ddd5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:54.173Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=fdc52f95-df28-4bfa-b2d6-ed5c384ddd5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=100 EndTimestamp=2021-07-13T00:19:54.173Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:54.073Z InvocationID=f838c4ea-f1bc-4fdc-8c7b-45f47a07fe67 ResponseDesc=Internal Server Error 2021-07-13T00:19:55.464Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=74b516c7-beef-4333-94b4-d68749fa0b8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:55.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:55.463Z InvocationID=84b67e0b-1acf-4c42-9793-53a2e216b5c2 2021-07-13T00:19:55.557Z [qtp817348612-49] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=74b516c7-beef-4333-94b4-d68749fa0b8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:55.570Z [qtp817348612-49] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=74b516c7-beef-4333-94b4-d68749fa0b8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:55.662Z [qtp817348612-49] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=74b516c7-beef-4333-94b4-d68749fa0b8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:55.663Z [qtp817348612-49] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=74b516c7-beef-4333-94b4-d68749fa0b8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:55.664Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=74b516c7-beef-4333-94b4-d68749fa0b8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=201 EndTimestamp=2021-07-13T00:19:55.664Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:55.463Z InvocationID=cf6e76a0-31b3-4ffe-be8d-3925778f8325 ResponseDesc=Internal Server Error 2021-07-13T00:19:56.569Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bde37514-a498-429c-a4c7-a0497726eba7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:56.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:56.569Z InvocationID=01970951-a91f-4b9b-abbf-fcb4dc17588e 2021-07-13T00:19:56.657Z [qtp817348612-16] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bde37514-a498-429c-a4c7-a0497726eba7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:56.664Z [qtp817348612-16] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=bde37514-a498-429c-a4c7-a0497726eba7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:56.670Z [qtp817348612-16] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=bde37514-a498-429c-a4c7-a0497726eba7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:56.670Z [qtp817348612-16] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=bde37514-a498-429c-a4c7-a0497726eba7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:56.671Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=bde37514-a498-429c-a4c7-a0497726eba7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=102 EndTimestamp=2021-07-13T00:19:56.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:56.569Z InvocationID=bbe8e0f7-34f6-47c4-a535-5008dcad1452 ResponseDesc=Internal Server Error 2021-07-13T00:19:57.972Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3cdc56cd-f489-406a-833f-c61480b46414 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:57.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:57.972Z InvocationID=a31ac622-399a-446f-9327-390f49f1566e 2021-07-13T00:19:58.060Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3cdc56cd-f489-406a-833f-c61480b46414 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:58.067Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3cdc56cd-f489-406a-833f-c61480b46414 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:58.073Z [qtp817348612-17] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=3cdc56cd-f489-406a-833f-c61480b46414 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:58.073Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3cdc56cd-f489-406a-833f-c61480b46414 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:58.074Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=3cdc56cd-f489-406a-833f-c61480b46414 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=102 EndTimestamp=2021-07-13T00:19:58.074Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:57.972Z InvocationID=9ae4b3c0-ac0d-48c6-8d47-77dbe942d2f2 ResponseDesc=Internal Server Error 2021-07-13T00:19:59.170Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8a5eb243-6bcd-4d13-9a84-a160778f3e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:19:59.170Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:59.170Z InvocationID=9c436729-4b2b-4b19-9abb-c5a5b432e47c 2021-07-13T00:19:59.260Z [qtp817348612-47] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8a5eb243-6bcd-4d13-9a84-a160778f3e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:59.266Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=8a5eb243-6bcd-4d13-9a84-a160778f3e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:59.271Z [qtp817348612-47] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=8a5eb243-6bcd-4d13-9a84-a160778f3e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:59.271Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=8a5eb243-6bcd-4d13-9a84-a160778f3e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:19:59.272Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=8a5eb243-6bcd-4d13-9a84-a160778f3e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=102 EndTimestamp=2021-07-13T00:19:59.272Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:19:59.170Z InvocationID=8031e010-868f-4b15-b4c6-d1241fe6af98 ResponseDesc=Internal Server Error 2021-07-13T00:20:00.065Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=727eaaa3-0c4c-4075-836c-7c4cabdf3c50 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:00.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:00.064Z InvocationID=651ede70-490b-4525-b332-1eb4d7f3f503 2021-07-13T00:20:00.072Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=727eaaa3-0c4c-4075-836c-7c4cabdf3c50 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:00.077Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=727eaaa3-0c4c-4075-836c-7c4cabdf3c50 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:00.084Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=727eaaa3-0c4c-4075-836c-7c4cabdf3c50 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:00.084Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=727eaaa3-0c4c-4075-836c-7c4cabdf3c50 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:00.085Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=727eaaa3-0c4c-4075-836c-7c4cabdf3c50 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=21 EndTimestamp=2021-07-13T00:20:00.085Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:00.064Z InvocationID=6668652d-7aba-4c61-bc8e-7a92e63beee1 ResponseDesc=Internal Server Error 2021-07-13T00:20:00.970Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be7f1395-00fe-4538-9191-7ec6e517a74b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:00.969Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:00.969Z InvocationID=eb5d3072-f8bb-4fa9-9842-dae9688e3686 2021-07-13T00:20:01.059Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be7f1395-00fe-4538-9191-7ec6e517a74b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:01.065Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=be7f1395-00fe-4538-9191-7ec6e517a74b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:01.072Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=be7f1395-00fe-4538-9191-7ec6e517a74b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:01.072Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=be7f1395-00fe-4538-9191-7ec6e517a74b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:01.073Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=be7f1395-00fe-4538-9191-7ec6e517a74b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=104 EndTimestamp=2021-07-13T00:20:01.073Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:00.969Z InvocationID=e0d2f3db-3d72-4bf7-a45f-0459962e0ce6 ResponseDesc=Internal Server Error 2021-07-13T00:20:01.963Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1e6d9dfe-139a-4f5f-9880-438529953500 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:01.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:01.963Z InvocationID=06022630-f282-4199-a52c-9a1d69dab9df 2021-07-13T00:20:02.057Z [qtp817348612-20] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1e6d9dfe-139a-4f5f-9880-438529953500 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:02.064Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1e6d9dfe-139a-4f5f-9880-438529953500 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:02.070Z [qtp817348612-20] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=1e6d9dfe-139a-4f5f-9880-438529953500 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:02.070Z [qtp817348612-20] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=1e6d9dfe-139a-4f5f-9880-438529953500 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:02.071Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=1e6d9dfe-139a-4f5f-9880-438529953500 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=108 EndTimestamp=2021-07-13T00:20:02.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:01.963Z InvocationID=c4be5c83-0361-4c91-9a30-cdbb97f01831 ResponseDesc=Internal Server Error 2021-07-13T00:20:02.330Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=176cbf80-3682-4d32-94ce-026232c93a9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:02.330Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:02.330Z InvocationID=76bd98a5-9cd3-47bc-82cc-6bcbe93d3c23 2021-07-13T00:20:02.363Z [qtp817348612-14] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=176cbf80-3682-4d32-94ce-026232c93a9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:02.368Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=176cbf80-3682-4d32-94ce-026232c93a9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:02.464Z [qtp817348612-14] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=176cbf80-3682-4d32-94ce-026232c93a9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:02.464Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=176cbf80-3682-4d32-94ce-026232c93a9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:02.465Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=176cbf80-3682-4d32-94ce-026232c93a9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=134 EndTimestamp=2021-07-13T00:20:02.464Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:02.330Z InvocationID=f0eb443c-84a0-422b-a603-2ef1dd303d1a ResponseDesc=Internal Server Error 2021-07-13T00:20:03.080Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d4ca8f31-8b9f-471b-89b7-8cbc5f93e956 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:03.080Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:03.080Z InvocationID=c05c9305-249b-480b-9464-a47485bc8d94 2021-07-13T00:20:03.164Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d4ca8f31-8b9f-471b-89b7-8cbc5f93e956 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:03.170Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d4ca8f31-8b9f-471b-89b7-8cbc5f93e956 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:03.176Z [qtp817348612-11] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=d4ca8f31-8b9f-471b-89b7-8cbc5f93e956 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:03.176Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d4ca8f31-8b9f-471b-89b7-8cbc5f93e956 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:03.177Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d4ca8f31-8b9f-471b-89b7-8cbc5f93e956 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=97 EndTimestamp=2021-07-13T00:20:03.177Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:03.080Z InvocationID=93cbf2e0-49ae-4e8b-91a0-bda5b5f4d27b ResponseDesc=Internal Server Error 2021-07-13T00:20:04.265Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9b3c016d-6246-4e0b-8093-905d452834ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:04.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:04.265Z InvocationID=3250d831-44c0-4abb-84db-7b80221cec7a 2021-07-13T00:20:04.363Z [qtp817348612-48] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9b3c016d-6246-4e0b-8093-905d452834ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:04.368Z [qtp817348612-48] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9b3c016d-6246-4e0b-8093-905d452834ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:04.374Z [qtp817348612-48] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=9b3c016d-6246-4e0b-8093-905d452834ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:04.374Z [qtp817348612-48] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9b3c016d-6246-4e0b-8093-905d452834ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:04.376Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=9b3c016d-6246-4e0b-8093-905d452834ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=110 EndTimestamp=2021-07-13T00:20:04.375Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:04.265Z InvocationID=272814ea-9211-4980-a0e3-cbdfd55b0a7d ResponseDesc=Internal Server Error 2021-07-13T00:20:05.277Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=54cf74f0-6c9c-493d-b61a-d0c98dc27da4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:05.277Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:05.277Z InvocationID=ffe2e49f-ba51-4856-ac18-baeab2bfc32d 2021-07-13T00:20:05.362Z [qtp817348612-18] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=54cf74f0-6c9c-493d-b61a-d0c98dc27da4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:05.368Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=54cf74f0-6c9c-493d-b61a-d0c98dc27da4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:05.373Z [qtp817348612-18] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=54cf74f0-6c9c-493d-b61a-d0c98dc27da4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:05.373Z [qtp817348612-18] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=54cf74f0-6c9c-493d-b61a-d0c98dc27da4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:05.374Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=54cf74f0-6c9c-493d-b61a-d0c98dc27da4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=97 EndTimestamp=2021-07-13T00:20:05.374Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:05.277Z InvocationID=74b6accf-b58d-40e3-8f1b-216bef3d1b83 ResponseDesc=Internal Server Error 2021-07-13T00:20:06.465Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=710e67c9-347a-474e-8dd9-fd7eff81320b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:06.465Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:06.465Z InvocationID=02dfb04b-fc07-4832-bed0-5bd69c6624df 2021-07-13T00:20:06.471Z [qtp817348612-49] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=710e67c9-347a-474e-8dd9-fd7eff81320b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:06.560Z [qtp817348612-49] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=710e67c9-347a-474e-8dd9-fd7eff81320b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:06.567Z [qtp817348612-49] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=710e67c9-347a-474e-8dd9-fd7eff81320b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:06.567Z [qtp817348612-49] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=710e67c9-347a-474e-8dd9-fd7eff81320b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:06.567Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=710e67c9-347a-474e-8dd9-fd7eff81320b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=102 EndTimestamp=2021-07-13T00:20:06.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:06.465Z InvocationID=227f083f-7dc9-4682-94cd-84c72c1b8cfe ResponseDesc=Internal Server Error 2021-07-13T00:20:07.662Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=44411ea7-c314-4e14-ae83-9b29eba7b544 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:07.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:07.662Z InvocationID=ca81e4f5-7bc5-43d4-ba8f-12b10bc148e9 2021-07-13T00:20:07.668Z [qtp817348612-16] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=44411ea7-c314-4e14-ae83-9b29eba7b544 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:07.673Z [qtp817348612-16] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=44411ea7-c314-4e14-ae83-9b29eba7b544 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:07.760Z [qtp817348612-16] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=44411ea7-c314-4e14-ae83-9b29eba7b544 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:07.761Z [qtp817348612-16] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=44411ea7-c314-4e14-ae83-9b29eba7b544 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:07.762Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=44411ea7-c314-4e14-ae83-9b29eba7b544 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=99 EndTimestamp=2021-07-13T00:20:07.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:07.662Z InvocationID=c40af404-3070-43e2-857a-cf803fcd9296 ResponseDesc=Internal Server Error 2021-07-13T00:20:08.761Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=27c9f824-d68b-44d9-b84a-8f8a785c4ae2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:08.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:08.761Z InvocationID=9dc53456-762b-472e-94c7-713c58c3807a 2021-07-13T00:20:08.767Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=27c9f824-d68b-44d9-b84a-8f8a785c4ae2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:08.772Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=27c9f824-d68b-44d9-b84a-8f8a785c4ae2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:08.860Z [qtp817348612-17] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=27c9f824-d68b-44d9-b84a-8f8a785c4ae2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:08.860Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=27c9f824-d68b-44d9-b84a-8f8a785c4ae2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:08.861Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=27c9f824-d68b-44d9-b84a-8f8a785c4ae2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=100 EndTimestamp=2021-07-13T00:20:08.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:08.761Z InvocationID=377f1788-9544-46cc-9daa-a0661c8328be ResponseDesc=Internal Server Error 2021-07-13T00:20:10.265Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d1e01f8b-8dd4-421a-b235-c77bbc6f4f74 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:10.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:10.265Z InvocationID=92561904-6aee-4dea-a9ca-8b26171d04ff 2021-07-13T00:20:10.272Z [qtp817348612-47] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d1e01f8b-8dd4-421a-b235-c77bbc6f4f74 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:10.662Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d1e01f8b-8dd4-421a-b235-c77bbc6f4f74 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:10.668Z [qtp817348612-47] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=d1e01f8b-8dd4-421a-b235-c77bbc6f4f74 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:10.668Z [qtp817348612-47] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d1e01f8b-8dd4-421a-b235-c77bbc6f4f74 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:10.669Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d1e01f8b-8dd4-421a-b235-c77bbc6f4f74 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=404 EndTimestamp=2021-07-13T00:20:10.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:10.265Z InvocationID=2e8f0370-754a-426d-baa0-131c40087868 ResponseDesc=Internal Server Error 2021-07-13T00:20:11.570Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5d93765c-0a23-42a9-854a-e444219fcd17 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:11.570Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:11.570Z InvocationID=e7ec7174-0d32-40a9-b65c-3566787a54e3 2021-07-13T00:20:11.576Z [qtp817348612-15] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5d93765c-0a23-42a9-854a-e444219fcd17 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:11.660Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5d93765c-0a23-42a9-854a-e444219fcd17 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:11.669Z [qtp817348612-15] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=5d93765c-0a23-42a9-854a-e444219fcd17 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:11.670Z [qtp817348612-15] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5d93765c-0a23-42a9-854a-e444219fcd17 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:11.671Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=5d93765c-0a23-42a9-854a-e444219fcd17 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=101 EndTimestamp=2021-07-13T00:20:11.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:11.570Z InvocationID=f557ca38-93c3-464e-960c-b6a4e66c475c ResponseDesc=Internal Server Error 2021-07-13T00:20:12.330Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cf7f4043-20ea-4e1e-98e8-1bf603384551 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:20:12.330Z ElapsedTime=0 EndTimestamp=2021-07-13T00:20:12.330Z InvocationID=81d90a22-96c7-43dd-b2cd-6e1127ef2d78 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:20:12.366Z [qtp817348612-50] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cf7f4043-20ea-4e1e-98e8-1bf603384551 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:12.372Z [qtp817348612-50] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=cf7f4043-20ea-4e1e-98e8-1bf603384551 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:12.462Z [qtp817348612-50] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=cf7f4043-20ea-4e1e-98e8-1bf603384551 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:12.462Z [qtp817348612-50] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=cf7f4043-20ea-4e1e-98e8-1bf603384551 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:12.464Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=cf7f4043-20ea-4e1e-98e8-1bf603384551 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=133 EndTimestamp=2021-07-13T00:20:12.463Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:12.330Z InvocationID=70d14542-e933-44de-93a0-f30c2809c3b8 ResponseDesc=Internal Server Error 2021-07-13T00:20:12.532Z [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE 2021-07-13T00:20:12.534Z [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.199.132:9042, scheduling retry in 30000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.199.132:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T00:20:12.566Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e769d5db-da72-4158-85e9-fbccc4580d46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:12.566Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:12.566Z InvocationID=96ed1e3d-d6c2-40f2-b05b-d28d4ce68779 2021-07-13T00:20:12.572Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e769d5db-da72-4158-85e9-fbccc4580d46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:12.660Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e769d5db-da72-4158-85e9-fbccc4580d46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:12.666Z [qtp817348612-19] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=e769d5db-da72-4158-85e9-fbccc4580d46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:12.666Z [qtp817348612-19] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e769d5db-da72-4158-85e9-fbccc4580d46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:12.667Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=e769d5db-da72-4158-85e9-fbccc4580d46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=100 EndTimestamp=2021-07-13T00:20:12.666Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:12.566Z InvocationID=88919049-da23-44be-9717-68dbefe10c22 ResponseDesc=Internal Server Error 2021-07-13T00:20:13.764Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bc97b36f-2c1f-438f-bcc0-6ce3e1922117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:13.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:13.764Z InvocationID=c86c845d-e2ab-443e-b183-78211bb14c7a 2021-07-13T00:20:13.860Z [qtp817348612-14] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bc97b36f-2c1f-438f-bcc0-6ce3e1922117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:13.869Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=bc97b36f-2c1f-438f-bcc0-6ce3e1922117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:13.960Z [qtp817348612-14] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=bc97b36f-2c1f-438f-bcc0-6ce3e1922117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:13.960Z [qtp817348612-14] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=bc97b36f-2c1f-438f-bcc0-6ce3e1922117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:20:13.961Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=bc97b36f-2c1f-438f-bcc0-6ce3e1922117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=197 EndTimestamp=2021-07-13T00:20:13.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:13.764Z InvocationID=82f26459-ee4c-4a78-b27c-356293e8ad3b ResponseDesc=Internal Server Error 2021-07-13T00:20:15.162Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6ada699a-f55d-48b4-9102-b08090993276 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:15.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:15.161Z InvocationID=233e1bfe-2984-4b07-9184-c8b179b0180c 2021-07-13T00:20:15.266Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6ada699a-f55d-48b4-9102-b08090993276 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:15.566Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6ada699a-f55d-48b4-9102-b08090993276 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=405 EndTimestamp=2021-07-13T00:20:15.566Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:15.161Z InvocationID=563d1d65-b4ba-4764-8623-a6710702f9ee ResponseDesc=OK 2021-07-13T00:20:16.369Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=95e91910-554f-4780-93eb-f0ce150704b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:16.369Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:16.369Z InvocationID=90467a08-70e5-4717-badb-fec2d69002d6 2021-07-13T00:20:16.660Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=95e91910-554f-4780-93eb-f0ce150704b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:17.259Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=95e91910-554f-4780-93eb-f0ce150704b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=889 EndTimestamp=2021-07-13T00:20:17.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:16.369Z InvocationID=a9a53b3f-b85a-4564-8e84-af62b114b1d3 ResponseDesc=OK 2021-07-13T00:20:18.473Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3381821a-f4e8-4491-abb0-432eee36bca9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:18.472Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:18.472Z InvocationID=2ec3a650-eb90-49a5-a29c-d2a46ca0f135 2021-07-13T00:20:18.657Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3381821a-f4e8-4491-abb0-432eee36bca9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:18.858Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3381821a-f4e8-4491-abb0-432eee36bca9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=386 EndTimestamp=2021-07-13T00:20:18.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:18.472Z InvocationID=9af743da-e027-4d94-840e-492fc2ab8917 ResponseDesc=OK 2021-07-13T00:20:19.868Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=29d7715e-d6d0-4936-b9d1-cbfddf63156f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:19.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:19.868Z InvocationID=30485c28-5731-49dc-8351-540bf9f4eed2 2021-07-13T00:20:19.960Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=29d7715e-d6d0-4936-b9d1-cbfddf63156f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:20.428Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=29d7715e-d6d0-4936-b9d1-cbfddf63156f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=559 EndTimestamp=2021-07-13T00:20:20.427Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:19.868Z InvocationID=b039b4a9-22d0-417f-8c7b-2b26f3454b1a ResponseDesc=OK 2021-07-13T00:20:21.370Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5d3e10b5-d66d-40b7-9629-e56b7cf4c17a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:21.369Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:21.369Z InvocationID=c1b439dc-0c03-43c1-bd00-a57eadd72afd 2021-07-13T00:20:21.611Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5d3e10b5-d66d-40b7-9629-e56b7cf4c17a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:22.333Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2f79d227-5914-466e-b8a0-714ce0db5257 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:22.332Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:22.332Z InvocationID=ed36b1a1-4ccc-44ad-8b7b-fe3fc23d9c8d 2021-07-13T00:20:22.360Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5d3e10b5-d66d-40b7-9629-e56b7cf4c17a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=991 EndTimestamp=2021-07-13T00:20:22.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:21.369Z InvocationID=d7601dd5-c93f-44d5-84df-22acc31a4cec ResponseDesc=OK 2021-07-13T00:20:23.371Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fe649323-31cc-4aac-9351-409b7cdd4259 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:23.370Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:23.370Z InvocationID=a6b9d72c-10aa-4af1-8152-a00e5d1ccef4 2021-07-13T00:20:23.657Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2f79d227-5914-466e-b8a0-714ce0db5257 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:23.728Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fe649323-31cc-4aac-9351-409b7cdd4259 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:23.959Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2f79d227-5914-466e-b8a0-714ce0db5257 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1627 EndTimestamp=2021-07-13T00:20:23.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:22.332Z InvocationID=2193efef-394b-458f-b682-f678fe2842f2 ResponseDesc=OK 2021-07-13T00:20:24.014Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fe649323-31cc-4aac-9351-409b7cdd4259 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=644 EndTimestamp=2021-07-13T00:20:24.014Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:23.370Z InvocationID=6eb4fb57-541d-4da1-b943-34e0032f9674 ResponseDesc=OK 2021-07-13T00:20:25.160Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7ef07f21-54a4-4024-bdf6-f234d8ba7efa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:25.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:25.160Z InvocationID=7219d7b1-fabb-41af-9e92-7d5a7616db29 2021-07-13T00:20:25.815Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7ef07f21-54a4-4024-bdf6-f234d8ba7efa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:26.161Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7ef07f21-54a4-4024-bdf6-f234d8ba7efa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1001 EndTimestamp=2021-07-13T00:20:26.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:25.160Z InvocationID=778b38ee-6d15-4294-ac67-a0718cc6f23e ResponseDesc=OK 2021-07-13T00:20:27.369Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6500fb5c-e9fa-4807-b1f1-1c60dcbbb5c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:27.369Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:27.369Z InvocationID=f0d91f98-ce77-44b3-9e53-a3ed78e08a74 2021-07-13T00:20:27.440Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=03507eb9-e982-485d-b5b1-382d4af68faf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:27.439Z InvocationID=7616f1bd-7c9c-4147-96ea-4d0e46f7f40f 2021-07-13T00:20:27.557Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6500fb5c-e9fa-4807-b1f1-1c60dcbbb5c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:27.727Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=03507eb9-e982-485d-b5b1-382d4af68faf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:27.758Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6500fb5c-e9fa-4807-b1f1-1c60dcbbb5c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=389 EndTimestamp=2021-07-13T00:20:27.758Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:27.369Z InvocationID=9de09de2-9b36-45d4-ac40-5dddb8d321d0 ResponseDesc=OK 2021-07-13T00:20:28.212Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=03507eb9-e982-485d-b5b1-382d4af68faf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=773 EndTimestamp=2021-07-13T00:20:28.212Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:27.439Z InvocationID=d80327ec-4278-4c81-9914-0c456b35e610 ResponseDesc=OK 2021-07-13T00:20:28.876Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=28445f2f-78dd-4948-8a8d-481ab34b9b3d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:28.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:28.875Z InvocationID=0d4db0d1-0ee5-481e-b856-bf3404d51508 2021-07-13T00:20:29.771Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3aa5790d-6d6a-4f1d-8c6f-0d833b532676 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:29.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:29.770Z InvocationID=666b87f6-be0d-4847-9f73-474052a34b70 2021-07-13T00:20:30.058Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3aa5790d-6d6a-4f1d-8c6f-0d833b532676 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:30.217Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=28445f2f-78dd-4948-8a8d-481ab34b9b3d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:30.363Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3aa5790d-6d6a-4f1d-8c6f-0d833b532676 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=592 EndTimestamp=2021-07-13T00:20:30.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:29.770Z InvocationID=6f432fab-f461-4319-9a1c-5a2cd07e6d08 ResponseDesc=OK 2021-07-13T00:20:30.558Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=28445f2f-78dd-4948-8a8d-481ab34b9b3d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1682 EndTimestamp=2021-07-13T00:20:30.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:28.875Z InvocationID=c62962fb-36cf-4bc6-b1a6-6b9c658ba326 ResponseDesc=OK 2021-07-13T00:20:32.869Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9181e5fd-1335-407e-bfc2-fd3d3318bfb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:32.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:32.869Z InvocationID=e5a2e867-923b-43ad-a333-53cf1949439c 2021-07-13T00:20:33.260Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9181e5fd-1335-407e-bfc2-fd3d3318bfb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:33.616Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9181e5fd-1335-407e-bfc2-fd3d3318bfb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=747 EndTimestamp=2021-07-13T00:20:33.616Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:32.869Z InvocationID=5747b53a-417d-4ec5-b057-21cd44104ee0 ResponseDesc=OK 2021-07-13T00:20:35.769Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d21acd30-a22c-4fec-abe4-afcb1519fc11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:35.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:35.768Z InvocationID=a3776198-b512-49c3-909e-5b4298952762 2021-07-13T00:20:36.012Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d21acd30-a22c-4fec-abe4-afcb1519fc11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:36.260Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d21acd30-a22c-4fec-abe4-afcb1519fc11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=492 EndTimestamp=2021-07-13T00:20:36.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:35.768Z InvocationID=a5970b7f-64e6-4c0b-a676-42013b4ac7ed ResponseDesc=OK 2021-07-13T00:20:37.441Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ca06e2be-bf30-4e67-a717-6efe1cd64075 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:37.440Z InvocationID=f639d9a3-9591-43b1-8c6a-0158731f69d8 2021-07-13T00:20:37.557Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ca06e2be-bf30-4e67-a717-6efe1cd64075 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:37.858Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ca06e2be-bf30-4e67-a717-6efe1cd64075 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=418 EndTimestamp=2021-07-13T00:20:37.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:37.440Z InvocationID=722c08b9-7180-47ba-818d-0484e2e0aa2c ResponseDesc=OK 2021-07-13T00:20:38.771Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3802ead4-6090-4909-9388-7c86b943e182 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:38.771Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:38.771Z InvocationID=2351783a-1d38-4065-92fa-a54eb909e44c 2021-07-13T00:20:38.864Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3802ead4-6090-4909-9388-7c86b943e182 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:38.875Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=012729b4-730d-4643-a0af-e941fd02f3bf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:38.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:38.875Z InvocationID=5dd88830-5dbe-4a00-8f2c-a799adbd2bd4 2021-07-13T00:20:39.112Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=012729b4-730d-4643-a0af-e941fd02f3bf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:39.313Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3802ead4-6090-4909-9388-7c86b943e182 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=542 EndTimestamp=2021-07-13T00:20:39.313Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:38.771Z InvocationID=8c2c0ed9-19d9-44ec-a581-cc0e58e633bf ResponseDesc=OK 2021-07-13T00:20:39.361Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=012729b4-730d-4643-a0af-e941fd02f3bf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:20:39.361Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:38.875Z InvocationID=8b614a23-4f98-4a9c-a2c3-7e03a7012a1a ResponseDesc=OK 2021-07-13T00:20:41.964Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7c70ee80-dbb4-4aae-9b7a-a4b0859e70ec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:41.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:41.964Z InvocationID=53ad7a73-da36-4bcb-b643-d97256a8e2f3 2021-07-13T00:20:42.063Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7c70ee80-dbb4-4aae-9b7a-a4b0859e70ec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:42.460Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7c70ee80-dbb4-4aae-9b7a-a4b0859e70ec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:20:42.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:41.964Z InvocationID=446e3c3f-98fc-4936-be51-2f15018efb90 ResponseDesc=OK 2021-07-13T00:20:45.068Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2e3cbd92-5154-4da0-9e04-e8ff71306bc8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:45.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:45.068Z InvocationID=7c47ce53-3b8d-4eae-8fb6-a60285efce45 2021-07-13T00:20:45.173Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2e3cbd92-5154-4da0-9e04-e8ff71306bc8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:47.444Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4aecb0d5-9424-4507-9d1a-f3432293025c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:47.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:47.444Z InvocationID=9819ca08-29b7-4c86-b379-2d9b92864659 2021-07-13T00:20:48.822Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4aecb0d5-9424-4507-9d1a-f3432293025c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:48.876Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=edee7375-36d5-4eb5-bf40-d85cc9ddd90f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:48.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:48.876Z InvocationID=f062e147-7f8c-4c63-ab72-b08e9db5aaa5 2021-07-13T00:20:48.919Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2e3cbd92-5154-4da0-9e04-e8ff71306bc8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3851 EndTimestamp=2021-07-13T00:20:48.919Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:45.068Z InvocationID=01f89be0-1c8b-4860-85c3-73299bf3ec12 ResponseDesc=OK 2021-07-13T00:20:49.157Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=edee7375-36d5-4eb5-bf40-d85cc9ddd90f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:49.235Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5c3938ec-b558-44f6-bf20-a084b8d15c12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:49.234Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:49.234Z InvocationID=5048f1fa-81b9-4753-a1b2-8598da9275f8 2021-07-13T00:20:49.860Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5c3938ec-b558-44f6-bf20-a084b8d15c12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:49.863Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4aecb0d5-9424-4507-9d1a-f3432293025c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2418 EndTimestamp=2021-07-13T00:20:49.862Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:47.444Z InvocationID=a67d7a55-52b8-4b1d-a380-8f6cbe263c17 ResponseDesc=OK 2021-07-13T00:20:50.658Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5c3938ec-b558-44f6-bf20-a084b8d15c12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1423 EndTimestamp=2021-07-13T00:20:50.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:49.234Z InvocationID=f59f2126-0fd2-4a87-881a-a56ed1c3d2c7 ResponseDesc=OK 2021-07-13T00:20:50.813Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=edee7375-36d5-4eb5-bf40-d85cc9ddd90f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1936 EndTimestamp=2021-07-13T00:20:50.812Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:48.876Z InvocationID=7a17f6dc-eba7-463d-b1b5-69079873ab28 ResponseDesc=OK 2021-07-13T00:20:51.769Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b965de44-2a28-4fd0-9501-78d70ae4974b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:51.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:51.769Z InvocationID=341ee390-da86-46cb-8826-ae8f20b3e73b 2021-07-13T00:20:52.319Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b965de44-2a28-4fd0-9501-78d70ae4974b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:52.561Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b965de44-2a28-4fd0-9501-78d70ae4974b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=792 EndTimestamp=2021-07-13T00:20:52.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:51.769Z InvocationID=4f0693d8-7fe4-4e7c-9d62-fe16ee75e614 ResponseDesc=OK 2021-07-13T00:20:53.664Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=858a27f2-51a5-4cd6-aa9a-6997e30dc1b9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:53.664Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:53.664Z InvocationID=452a6223-5903-4dd8-9813-212ab19e3e90 2021-07-13T00:20:53.857Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=858a27f2-51a5-4cd6-aa9a-6997e30dc1b9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:54.558Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=858a27f2-51a5-4cd6-aa9a-6997e30dc1b9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=894 EndTimestamp=2021-07-13T00:20:54.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:53.664Z InvocationID=3b2c6418-2cb9-46e5-bf5e-1f059f682147 ResponseDesc=OK 2021-07-13T00:20:56.681Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=12639a7c-ebcd-43a5-94fc-a3535554f0e3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:56.681Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:56.681Z InvocationID=12af4da6-e2f0-498a-a190-d46deff706c4 2021-07-13T00:20:56.860Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=12639a7c-ebcd-43a5-94fc-a3535554f0e3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:57.216Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=12639a7c-ebcd-43a5-94fc-a3535554f0e3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=535 EndTimestamp=2021-07-13T00:20:57.216Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:56.681Z InvocationID=d2743284-bc4f-4bcd-8118-8dac3c0f4281 ResponseDesc=OK 2021-07-13T00:20:57.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d1e9c182-a03b-4113-ac3e-010c82c53117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:57.440Z InvocationID=df7fe007-e879-4c4f-8603-1baa7ed5355b 2021-07-13T00:20:57.713Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d1e9c182-a03b-4113-ac3e-010c82c53117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:57.866Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d1e9c182-a03b-4113-ac3e-010c82c53117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=426 EndTimestamp=2021-07-13T00:20:57.866Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:57.440Z InvocationID=87eb9e12-9f19-4be9-b1a7-c7861b4ce231 ResponseDesc=OK 2021-07-13T00:20:58.874Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ed96473d-31d3-4cec-805e-b0a152238ed5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:58.874Z InvocationID=7094c222-5fdc-4716-bf79-f6fe208802d7 2021-07-13T00:20:59.060Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ed96473d-31d3-4cec-805e-b0a152238ed5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:20:59.458Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ed96473d-31d3-4cec-805e-b0a152238ed5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=583 EndTimestamp=2021-07-13T00:20:59.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:58.874Z InvocationID=b6fb8d53-94af-424c-b6ea-8b45fefdfe71 ResponseDesc=OK 2021-07-13T00:20:59.873Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=41ab519c-c76b-4903-97ec-c540de8bbdb7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:20:59.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:59.873Z InvocationID=d3e47ca4-9b90-4389-8006-1fbdab68909a 2021-07-13T00:20:59.960Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=41ab519c-c76b-4903-97ec-c540de8bbdb7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:00.320Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=41ab519c-c76b-4903-97ec-c540de8bbdb7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=447 EndTimestamp=2021-07-13T00:21:00.320Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:20:59.873Z InvocationID=78e1a56b-3505-4e77-b6bc-8637563e158f ResponseDesc=OK 2021-07-13T00:21:03.165Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c25fbcd9-2067-4807-9e33-2565ee7dcd0d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:03.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:03.164Z InvocationID=aae0b250-f278-468f-b7bf-ed67757965a7 2021-07-13T00:21:03.612Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c25fbcd9-2067-4807-9e33-2565ee7dcd0d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:03.767Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c25fbcd9-2067-4807-9e33-2565ee7dcd0d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=602 EndTimestamp=2021-07-13T00:21:03.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:03.164Z InvocationID=1dba60d0-97cc-4b45-8c10-9587d55f6c94 ResponseDesc=OK 2021-07-13T00:21:05.777Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c87cbcbd-8bad-4a3e-95ea-d24656503815 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:05.777Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:05.777Z InvocationID=1ccb9be5-da07-47df-9172-f5d92abf3ecd 2021-07-13T00:21:05.957Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c87cbcbd-8bad-4a3e-95ea-d24656503815 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:06.658Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c87cbcbd-8bad-4a3e-95ea-d24656503815 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=881 EndTimestamp=2021-07-13T00:21:06.658Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:05.777Z InvocationID=e146fd39-dd3f-47d7-8745-b246797b9e10 ResponseDesc=OK 2021-07-13T00:21:07.440Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=27142887-900f-4d03-8862-74caea7c1518 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:07.440Z InvocationID=e07a98ea-f269-4176-9a50-10b6d6d1c633 2021-07-13T00:21:07.559Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=27142887-900f-4d03-8862-74caea7c1518 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:07.913Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=27142887-900f-4d03-8862-74caea7c1518 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=473 EndTimestamp=2021-07-13T00:21:07.913Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:07.440Z InvocationID=f3581177-9080-4f68-931d-05141eb712c4 ResponseDesc=OK 2021-07-13T00:21:08.876Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=87e6bb6e-745e-4b70-b79b-c7efe76a26fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:08.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:08.876Z InvocationID=3173c90f-67fb-4881-80e6-e675e65b291a 2021-07-13T00:21:09.076Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=67534b93-6c9f-437f-9430-79d13625280a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:09.075Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:09.075Z InvocationID=92d9382e-0aba-45bd-ae40-f21d7b4a096e 2021-07-13T00:21:09.264Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=67534b93-6c9f-437f-9430-79d13625280a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:09.323Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=87e6bb6e-745e-4b70-b79b-c7efe76a26fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:09.560Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=67534b93-6c9f-437f-9430-79d13625280a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=485 EndTimestamp=2021-07-13T00:21:09.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:09.075Z InvocationID=8d2785cd-33ac-415d-83c7-a6af8317a36b ResponseDesc=OK 2021-07-13T00:21:09.758Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=87e6bb6e-745e-4b70-b79b-c7efe76a26fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=882 EndTimestamp=2021-07-13T00:21:09.758Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:08.876Z InvocationID=0a398453-1d30-480d-bc2d-2e2ad6b9da7a ResponseDesc=OK 2021-07-13T00:21:12.070Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=196bb2f9-915d-4493-8a70-f9924a9d364f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:12.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:12.069Z InvocationID=32ab05d9-bb8f-4a17-a9e3-5cf93f59111c 2021-07-13T00:21:12.259Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=196bb2f9-915d-4493-8a70-f9924a9d364f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:12.812Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=196bb2f9-915d-4493-8a70-f9924a9d364f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=743 EndTimestamp=2021-07-13T00:21:12.812Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:12.069Z InvocationID=db93e180-524c-4417-aac8-5770c16a5b2c ResponseDesc=OK 2021-07-13T00:21:15.165Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a4206ab5-a909-41af-b60f-2ac7a6a14332 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:15.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:15.165Z InvocationID=4df8bbf5-ed37-4a59-83ad-c0ac53cb2195 2021-07-13T00:21:15.416Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a4206ab5-a909-41af-b60f-2ac7a6a14332 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:15.660Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a4206ab5-a909-41af-b60f-2ac7a6a14332 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:21:15.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:15.165Z InvocationID=74a6d7aa-f4f9-4156-ac30-aa8351fed2f5 ResponseDesc=OK 2021-07-13T00:21:17.450Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7705a301-6843-4c29-a72e-edd4c18a931c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:17.450Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:17.450Z InvocationID=28088243-1b6a-42ec-a02a-7a453f5dec3a 2021-07-13T00:21:17.615Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7705a301-6843-4c29-a72e-edd4c18a931c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:17.868Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=722ea29b-139e-4e4d-b6ef-42fab51b1b2f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:17.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:17.868Z InvocationID=b9d0868d-323c-49ed-92d1-74edf3c7abe0 2021-07-13T00:21:18.874Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=23179fe9-562f-49e9-8d60-b7722f44524c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:18.873Z InvocationID=5a94d73c-e7c5-4c55-8f20-7a14ce8ada22 2021-07-13T00:21:19.057Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=23179fe9-562f-49e9-8d60-b7722f44524c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:19.361Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=722ea29b-139e-4e4d-b6ef-42fab51b1b2f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:20.758Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7705a301-6843-4c29-a72e-edd4c18a931c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3307 EndTimestamp=2021-07-13T00:21:20.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:17.450Z InvocationID=27e3be96-46e7-413e-a0d3-2f702e9998ea ResponseDesc=OK 2021-07-13T00:21:20.863Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=23179fe9-562f-49e9-8d60-b7722f44524c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1990 EndTimestamp=2021-07-13T00:21:20.863Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:18.873Z InvocationID=4028398e-88b7-4cd9-b5c3-9c4a7e75472b ResponseDesc=OK 2021-07-13T00:21:21.036Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=722ea29b-139e-4e4d-b6ef-42fab51b1b2f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3168 EndTimestamp=2021-07-13T00:21:21.036Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:17.868Z InvocationID=e6aff5a5-07be-4375-9cf8-f592c984c216 ResponseDesc=OK 2021-07-13T00:21:21.926Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f65fbc40-7ed0-46e5-8cb5-6b4ea7aadfff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:21.926Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:21.926Z InvocationID=06c901ee-d2b8-4633-8f6c-4d326e52e061 2021-07-13T00:21:22.057Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f65fbc40-7ed0-46e5-8cb5-6b4ea7aadfff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:22.458Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f65fbc40-7ed0-46e5-8cb5-6b4ea7aadfff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=532 EndTimestamp=2021-07-13T00:21:22.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:21.926Z InvocationID=5590d691-f3c9-4815-a97a-8b5c10b5616a ResponseDesc=OK 2021-07-13T00:21:23.871Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7475a3eb-d99a-4e10-99fc-c334fbd01f98 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:23.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:23.870Z InvocationID=7b68137f-4855-4888-9c0e-3ae5e1ac55c6 2021-07-13T00:21:24.059Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7475a3eb-d99a-4e10-99fc-c334fbd01f98 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:24.568Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7475a3eb-d99a-4e10-99fc-c334fbd01f98 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=698 EndTimestamp=2021-07-13T00:21:24.568Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:23.870Z InvocationID=b6d5e2ce-4f1c-4a20-a850-9d6e840be619 ResponseDesc=OK 2021-07-13T00:21:26.778Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b54bc195-5edb-47ea-b991-eddb5fad07f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:26.777Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:26.777Z InvocationID=a25ca77b-b2b7-4a9c-8aa4-2f1a80d62e4b 2021-07-13T00:21:27.218Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b54bc195-5edb-47ea-b991-eddb5fad07f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:27.440Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=21b58cf0-a858-4fb9-b77a-268ebdc76824 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:27.440Z InvocationID=3dbf3244-e9aa-4239-b2ee-d25f6abdc13a 2021-07-13T00:21:27.461Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b54bc195-5edb-47ea-b991-eddb5fad07f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=683 EndTimestamp=2021-07-13T00:21:27.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:26.777Z InvocationID=88e15cf4-df37-4381-a9d5-f9ff1418d6b0 ResponseDesc=OK 2021-07-13T00:21:27.556Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=21b58cf0-a858-4fb9-b77a-268ebdc76824 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:28.058Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=21b58cf0-a858-4fb9-b77a-268ebdc76824 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=618 EndTimestamp=2021-07-13T00:21:28.058Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:27.440Z InvocationID=a0246568-14d2-4ace-b887-cfddf8e6f39a ResponseDesc=OK 2021-07-13T00:21:28.874Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6545cbe3-0cf4-47d5-b57c-438856b69e51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:28.874Z InvocationID=7a01d145-cf9c-468e-b108-8449fbcad46d 2021-07-13T00:21:29.158Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6545cbe3-0cf4-47d5-b57c-438856b69e51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:29.666Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=43348262-40e3-45ff-a72d-2b145331db2b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:29.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:29.665Z InvocationID=652a709e-15ec-4344-970d-a96dbb106276 2021-07-13T00:21:33.014Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=43348262-40e3-45ff-a72d-2b145331db2b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:33.264Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=43348262-40e3-45ff-a72d-2b145331db2b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3599 EndTimestamp=2021-07-13T00:21:33.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:29.665Z InvocationID=38e19b20-663a-4025-96b0-7ceb650abb35 ResponseDesc=OK 2021-07-13T00:21:33.317Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6545cbe3-0cf4-47d5-b57c-438856b69e51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4442 EndTimestamp=2021-07-13T00:21:33.316Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:28.874Z InvocationID=05f71970-efbc-4b7e-959d-47a1d65b5704 ResponseDesc=OK 2021-07-13T00:21:33.804Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d52e455d-bd72-4ea3-ad63-f5b077c556e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:33.804Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:33.804Z InvocationID=7bab0c4d-0860-4410-9a2b-e29c6fc5e844 2021-07-13T00:21:34.356Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d52e455d-bd72-4ea3-ad63-f5b077c556e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:34.658Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d52e455d-bd72-4ea3-ad63-f5b077c556e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=853 EndTimestamp=2021-07-13T00:21:34.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:33.804Z InvocationID=e01f4573-04db-40bf-b9fe-2798e2f831d5 ResponseDesc=OK 2021-07-13T00:21:35.674Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ae1a8b1d-62f2-4185-bf2f-cce05e776bc4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:35.674Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:35.674Z InvocationID=9bd11113-bb83-44e9-ab60-3a9dbf43c3c1 2021-07-13T00:21:35.859Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ae1a8b1d-62f2-4185-bf2f-cce05e776bc4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:36.073Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ae1a8b1d-62f2-4185-bf2f-cce05e776bc4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=399 EndTimestamp=2021-07-13T00:21:36.073Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:35.674Z InvocationID=8b54034e-c29c-4a9e-afe8-10adcadfc941 ResponseDesc=OK 2021-07-13T00:21:37.440Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9812b23a-779b-47d2-8adb-fa69fb12ad95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:37.440Z InvocationID=6b28fdd0-4f2c-4638-9e37-46108bd5864c 2021-07-13T00:21:37.578Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9812b23a-779b-47d2-8adb-fa69fb12ad95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:38.163Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9812b23a-779b-47d2-8adb-fa69fb12ad95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=723 EndTimestamp=2021-07-13T00:21:38.163Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:37.440Z InvocationID=2a84ff12-86d8-4163-8b0e-1e5304f3e516 ResponseDesc=OK 2021-07-13T00:21:38.761Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=901c4efd-d185-451a-9b2a-e2d9ce9892e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:38.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:38.761Z InvocationID=b326103a-d193-4e24-b5c5-6b5abdea9271 2021-07-13T00:21:38.857Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=901c4efd-d185-451a-9b2a-e2d9ce9892e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:38.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f155de65-b7ea-4338-89ee-d3ced9013f48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:38.874Z InvocationID=4e243e7d-0614-4769-b6e3-969512d799ea 2021-07-13T00:21:39.059Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f155de65-b7ea-4338-89ee-d3ced9013f48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:39.357Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=901c4efd-d185-451a-9b2a-e2d9ce9892e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=596 EndTimestamp=2021-07-13T00:21:39.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:38.761Z InvocationID=4243176a-8274-4031-b763-020bee479c56 ResponseDesc=OK 2021-07-13T00:21:39.624Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f155de65-b7ea-4338-89ee-d3ced9013f48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=750 EndTimestamp=2021-07-13T00:21:39.624Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:38.874Z InvocationID=55ab6bfb-6ead-4518-9cbd-23e37279012c ResponseDesc=OK 2021-07-13T00:21:41.863Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ed6975d6-d627-4828-9151-9cd30874e610 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:41.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:41.862Z InvocationID=86dac3c0-35da-44bf-9d73-8583ed60e6a8 2021-07-13T00:21:43.812Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ed6975d6-d627-4828-9151-9cd30874e610 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:45.160Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ed6975d6-d627-4828-9151-9cd30874e610 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3298 EndTimestamp=2021-07-13T00:21:45.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:41.862Z InvocationID=e9656031-6d38-4a33-9f9d-658a3c7c0a0e ResponseDesc=OK 2021-07-13T00:21:45.919Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=caf01d9c-5cbd-4dd5-a20c-51f93f74dc5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:45.918Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:45.918Z InvocationID=9d6a838f-d66d-48a1-aed5-d3da22c81044 2021-07-13T00:21:46.456Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=caf01d9c-5cbd-4dd5-a20c-51f93f74dc5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:46.671Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=caf01d9c-5cbd-4dd5-a20c-51f93f74dc5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=752 EndTimestamp=2021-07-13T00:21:46.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:45.918Z InvocationID=35d5f689-a8c9-42bb-800c-d288aa8d3399 ResponseDesc=OK 2021-07-13T00:21:47.443Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=533cc109-76ce-4589-8b4b-eef48ba5ad04 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:47.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:47.443Z InvocationID=6f5805df-0467-4797-95d2-ffb6cb6d041a 2021-07-13T00:21:47.567Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=533cc109-76ce-4589-8b4b-eef48ba5ad04 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:48.017Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=533cc109-76ce-4589-8b4b-eef48ba5ad04 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=574 EndTimestamp=2021-07-13T00:21:48.017Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:47.443Z InvocationID=e24df77a-f725-4985-8b6a-79219a51214f ResponseDesc=OK 2021-07-13T00:21:48.065Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=969f24fe-aa30-46c2-8e16-e4dfb3e64908 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:48.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:48.065Z InvocationID=f8762144-3293-44d9-a8d8-2ab3cf364a22 2021-07-13T00:21:48.312Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=969f24fe-aa30-46c2-8e16-e4dfb3e64908 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:48.561Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=969f24fe-aa30-46c2-8e16-e4dfb3e64908 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:21:48.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:48.065Z InvocationID=e7213a57-5fcc-47d6-a445-6bdafc9d7c46 ResponseDesc=OK 2021-07-13T00:21:48.876Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cfcbb222-b83f-403d-8dbc-074f74ca83c9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:48.875Z InvocationID=085ba8bc-6c71-469c-879c-5e2e753824c8 2021-07-13T00:21:49.057Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cfcbb222-b83f-403d-8dbc-074f74ca83c9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:49.272Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cfcbb222-b83f-403d-8dbc-074f74ca83c9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=397 EndTimestamp=2021-07-13T00:21:49.272Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:48.875Z InvocationID=bf8f1821-cfea-4b0d-8986-2c15afa134fc ResponseDesc=OK 2021-07-13T00:21:50.773Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0e372228-9c80-4a21-b71e-ea61b873e863 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:50.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:50.772Z InvocationID=508bc4f7-5194-4dc1-ae95-e53a5901cc7e 2021-07-13T00:21:50.960Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0e372228-9c80-4a21-b71e-ea61b873e863 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:51.318Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0e372228-9c80-4a21-b71e-ea61b873e863 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=546 EndTimestamp=2021-07-13T00:21:51.318Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:50.772Z InvocationID=2dfe0622-6c7b-4b06-9034-0b9848d7577c ResponseDesc=OK 2021-07-13T00:21:53.861Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=992e638f-d04e-4116-ab39-faba8096b296 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:53.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:53.861Z InvocationID=febde8b7-3417-4f9d-8aa0-00f02e6a1f1b 2021-07-13T00:21:54.839Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=992e638f-d04e-4116-ab39-faba8096b296 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:55.060Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=992e638f-d04e-4116-ab39-faba8096b296 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1199 EndTimestamp=2021-07-13T00:21:55.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:53.861Z InvocationID=69b93188-a6ce-4e02-b962-0a3177c4b2cd ResponseDesc=OK 2021-07-13T00:21:56.762Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=569f5434-6a84-4389-9ff9-20bbabf6ff48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:56.762Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:56.762Z InvocationID=895ef25a-6633-4f8d-a317-1a0d27cfe6ec 2021-07-13T00:21:56.867Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=569f5434-6a84-4389-9ff9-20bbabf6ff48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:57.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eb5901cf-ac34-491f-9fd8-f1310f209b49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:57.440Z InvocationID=30651cc9-c42a-4d7e-8670-463b6fdcb349 2021-07-13T00:21:57.557Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=569f5434-6a84-4389-9ff9-20bbabf6ff48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=795 EndTimestamp=2021-07-13T00:21:57.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:56.762Z InvocationID=1af41f86-46bf-4ce1-bbde-ec912af4f7b7 ResponseDesc=OK 2021-07-13T00:21:57.559Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eb5901cf-ac34-491f-9fd8-f1310f209b49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:58.012Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eb5901cf-ac34-491f-9fd8-f1310f209b49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=572 EndTimestamp=2021-07-13T00:21:58.012Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:57.440Z InvocationID=22ffc2c8-210f-4bd2-bd71-089d3f28ba53 ResponseDesc=OK 2021-07-13T00:21:58.874Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5da9510-fd34-4097-9cef-adfe95d6452e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:21:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:58.874Z InvocationID=dbad9a9d-cca3-4e31-be5f-e14121c2073a 2021-07-13T00:21:59.226Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5da9510-fd34-4097-9cef-adfe95d6452e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:21:59.460Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f5da9510-fd34-4097-9cef-adfe95d6452e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=586 EndTimestamp=2021-07-13T00:21:59.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:21:58.874Z InvocationID=daa8b52d-b082-4dac-979e-818061086cea ResponseDesc=OK 2021-07-13T00:22:00.064Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9c97a78a-42f5-424d-b184-767a7322fecd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:00.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:00.064Z InvocationID=77018514-e80d-4ebe-b4f7-67eb5fe570fe 2021-07-13T00:22:00.256Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9c97a78a-42f5-424d-b184-767a7322fecd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:00.558Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9c97a78a-42f5-424d-b184-767a7322fecd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=494 EndTimestamp=2021-07-13T00:22:00.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:00.064Z InvocationID=a0332010-6753-4cd9-9dbc-1a31501d1523 ResponseDesc=OK 2021-07-13T00:22:02.780Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d31e5a04-62c3-4515-a254-0f23216bf67e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:02.779Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:02.779Z InvocationID=2b997bce-0ef4-4fff-bed9-f4b59160e746 2021-07-13T00:22:02.867Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d31e5a04-62c3-4515-a254-0f23216bf67e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:04.013Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d31e5a04-62c3-4515-a254-0f23216bf67e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1234 EndTimestamp=2021-07-13T00:22:04.013Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:02.779Z InvocationID=83f3501a-7c75-4980-930b-b2e01975713b ResponseDesc=OK 2021-07-13T00:22:05.771Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6295be4e-e2a6-4f11-b66b-ec84041d5c8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:05.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:05.770Z InvocationID=0693b488-cdcd-4ec1-9919-9c9b3c702de5 2021-07-13T00:22:06.616Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6295be4e-e2a6-4f11-b66b-ec84041d5c8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:06.860Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6295be4e-e2a6-4f11-b66b-ec84041d5c8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1090 EndTimestamp=2021-07-13T00:22:06.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:05.770Z InvocationID=b19e94f3-2d61-48ca-9daa-58b6e3ce10aa ResponseDesc=OK 2021-07-13T00:22:07.440Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e7be1f05-6099-4073-a9ff-d6c4929746ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:07.440Z InvocationID=c2b407f9-f490-4ab1-a282-f3fabdabf070 2021-07-13T00:22:07.557Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e7be1f05-6099-4073-a9ff-d6c4929746ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:07.857Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e7be1f05-6099-4073-a9ff-d6c4929746ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=417 EndTimestamp=2021-07-13T00:22:07.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:07.440Z InvocationID=c3266a4a-a054-4e4a-b472-4a4f969fb970 ResponseDesc=OK 2021-07-13T00:22:08.577Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0fd98fe0-77a6-4b45-b73d-eecebf9961fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:08.577Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:08.577Z InvocationID=9b32a87e-3214-437d-863c-c464fa3512f4 2021-07-13T00:22:08.759Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0fd98fe0-77a6-4b45-b73d-eecebf9961fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:08.875Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6f572b3c-5c42-4e21-8e74-94d0995cfe4d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:08.874Z InvocationID=0727689e-12f9-4953-9abc-03d358c64ece 2021-07-13T00:22:09.619Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0fd98fe0-77a6-4b45-b73d-eecebf9961fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1042 EndTimestamp=2021-07-13T00:22:09.619Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:08.577Z InvocationID=1a3d4d36-3813-43ae-a8a3-3601c43f1c39 ResponseDesc=OK 2021-07-13T00:22:09.674Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6f572b3c-5c42-4e21-8e74-94d0995cfe4d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:09.960Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6f572b3c-5c42-4e21-8e74-94d0995cfe4d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1086 EndTimestamp=2021-07-13T00:22:09.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:08.874Z InvocationID=09756246-131f-48a8-9e60-1796387433be ResponseDesc=OK 2021-07-13T00:22:11.680Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3adde24f-d059-455e-aded-8a9eed5f0221 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:11.679Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:11.679Z InvocationID=9575108e-dee7-451e-83ed-5f6ebe8e0fe1 2021-07-13T00:22:11.857Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3adde24f-d059-455e-aded-8a9eed5f0221 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:12.158Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3adde24f-d059-455e-aded-8a9eed5f0221 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=478 EndTimestamp=2021-07-13T00:22:12.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:11.679Z InvocationID=5425509e-3e4b-4b96-95ab-11e63bb86dcf ResponseDesc=OK 2021-07-13T00:22:15.163Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a60524bc-9685-48dd-ba33-17e1000ecc68 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:15.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:15.162Z InvocationID=6ea2e66c-7b3e-43fd-97fa-8d42ba44f6ca 2021-07-13T00:22:15.359Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a60524bc-9685-48dd-ba33-17e1000ecc68 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:15.713Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a60524bc-9685-48dd-ba33-17e1000ecc68 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=550 EndTimestamp=2021-07-13T00:22:15.712Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:15.162Z InvocationID=1351d71c-062d-4e2b-a0f6-cae35f35fd1b ResponseDesc=OK 2021-07-13T00:22:17.443Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=98e61095-db8f-4250-989e-e50ad2355cee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:17.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:17.443Z InvocationID=f4714d89-3526-4da3-92a9-4abc8cd8a561 2021-07-13T00:22:17.712Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=98e61095-db8f-4250-989e-e50ad2355cee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:17.960Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=98e61095-db8f-4250-989e-e50ad2355cee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=517 EndTimestamp=2021-07-13T00:22:17.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:17.443Z InvocationID=57fd3efc-bb56-4ed9-b733-cd0347ca9a0a ResponseDesc=OK 2021-07-13T00:22:18.064Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cd78efc1-4055-4a24-b3d3-39b7155aa189 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:18.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:18.064Z InvocationID=1dcda951-c0c6-4f7a-b9fb-9ca17b417be0 2021-07-13T00:22:18.258Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cd78efc1-4055-4a24-b3d3-39b7155aa189 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:18.658Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cd78efc1-4055-4a24-b3d3-39b7155aa189 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=594 EndTimestamp=2021-07-13T00:22:18.658Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:18.064Z InvocationID=deaa84f9-f81f-4bfb-9619-188803942267 ResponseDesc=OK 2021-07-13T00:22:18.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c2d625ef-0d9e-49b4-b9a3-bb1f52339cec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:18.874Z InvocationID=dd22d41b-c462-4431-81fc-982487225027 2021-07-13T00:22:19.259Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c2d625ef-0d9e-49b4-b9a3-bb1f52339cec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:19.530Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c2d625ef-0d9e-49b4-b9a3-bb1f52339cec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=655 EndTimestamp=2021-07-13T00:22:19.529Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:18.874Z InvocationID=7f30e7fb-88cd-4c8b-90e1-08bf28bf046a ResponseDesc=OK 2021-07-13T00:22:21.066Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3c9631c4-aab0-4b62-803b-cedf24fb2499 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:21.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:21.066Z InvocationID=ce2b56b8-d2b3-43d6-be0c-b9759ebf8306 2021-07-13T00:22:21.411Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3c9631c4-aab0-4b62-803b-cedf24fb2499 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:21.660Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3c9631c4-aab0-4b62-803b-cedf24fb2499 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=594 EndTimestamp=2021-07-13T00:22:21.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:21.066Z InvocationID=21e835f5-44d6-47b1-ac02-a8ed479b010f ResponseDesc=OK 2021-07-13T00:22:23.572Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f9b78a3b-0b86-458e-ab57-3fcc9efaddb7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:23.572Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:23.572Z InvocationID=55979a9f-edae-4d56-a835-200da3c1f216 2021-07-13T00:22:23.956Z [qtp817348612-47] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f9b78a3b-0b86-458e-ab57-3fcc9efaddb7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:24.267Z [qtp817348612-47] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f9b78a3b-0b86-458e-ab57-3fcc9efaddb7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=694 EndTimestamp=2021-07-13T00:22:24.266Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:23.572Z InvocationID=9193f94b-aee1-46d8-8113-8ebc0a9ab486 ResponseDesc=OK 2021-07-13T00:22:26.766Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2b0f05ed-5d11-4c70-9fea-4322c24568a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:26.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:26.766Z InvocationID=06d03b2b-6d41-47a0-8cdc-2f24f193c973 2021-07-13T00:22:27.058Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2b0f05ed-5d11-4c70-9fea-4322c24568a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:27.445Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=65a659f7-9ac3-4a56-81cd-360adeaf97d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:27.445Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:27.445Z InvocationID=23cee26e-139c-496d-8f25-54758ca31eef 2021-07-13T00:22:27.921Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2b0f05ed-5d11-4c70-9fea-4322c24568a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1154 EndTimestamp=2021-07-13T00:22:27.920Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:26.766Z InvocationID=f4a27cdd-2719-4aa7-abb1-3f43529b75d0 ResponseDesc=OK 2021-07-13T00:22:28.871Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=65a659f7-9ac3-4a56-81cd-360adeaf97d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:28.877Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=76d28a5e-8950-41c8-8286-23604b3911a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:28.877Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:28.877Z InvocationID=7683ddf2-0da8-4289-9871-7087cc39b26a 2021-07-13T00:22:29.258Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=76d28a5e-8950-41c8-8286-23604b3911a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:29.361Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=65a659f7-9ac3-4a56-81cd-360adeaf97d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1916 EndTimestamp=2021-07-13T00:22:29.361Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:27.445Z InvocationID=1eba1b44-4d89-42fe-80b5-ede1393e0f19 ResponseDesc=OK 2021-07-13T00:22:29.564Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=76d28a5e-8950-41c8-8286-23604b3911a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=687 EndTimestamp=2021-07-13T00:22:29.564Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:28.877Z InvocationID=6767610b-e51a-44c9-aa95-030be7ddbd67 ResponseDesc=OK 2021-07-13T00:22:30.574Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3e25fac2-7f87-4495-8703-72faba625738 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:30.573Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:30.573Z InvocationID=b15e3fae-1a91-4e97-a658-053aced7d659 2021-07-13T00:22:30.760Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3e25fac2-7f87-4495-8703-72faba625738 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:31.073Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3e25fac2-7f87-4495-8703-72faba625738 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=500 EndTimestamp=2021-07-13T00:22:31.073Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:30.573Z InvocationID=a04a4391-e20a-43b6-af03-56a6d1395b0d ResponseDesc=OK 2021-07-13T00:22:32.686Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aba06e77-2442-44b2-89f9-38f3edbb95bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:32.685Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:32.685Z InvocationID=ff001fb8-09df-4bb2-9a38-ac9e156b6541 2021-07-13T00:22:34.119Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aba06e77-2442-44b2-89f9-38f3edbb95bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:34.360Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aba06e77-2442-44b2-89f9-38f3edbb95bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1675 EndTimestamp=2021-07-13T00:22:34.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:32.685Z InvocationID=44256855-8bc2-4be4-b21e-1eb0c89e81e5 ResponseDesc=OK 2021-07-13T00:22:35.673Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=00ac5a99-5703-459f-910e-687f33d62709 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:35.672Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:35.672Z InvocationID=7a4d5f56-1a19-457c-93f1-7081e66fa330 2021-07-13T00:22:35.965Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=00ac5a99-5703-459f-910e-687f33d62709 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:36.266Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=00ac5a99-5703-459f-910e-687f33d62709 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=593 EndTimestamp=2021-07-13T00:22:36.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:35.672Z InvocationID=5d1aaf13-b88b-42e7-bec7-0167af17662a ResponseDesc=OK 2021-07-13T00:22:37.441Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cc76d7fd-c737-40c7-b5f2-5b7af62799c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:37.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:37.441Z InvocationID=4e8e9871-678b-4870-8cd7-9c2ddf5d8bc4 2021-07-13T00:22:38.768Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fc4bbc44-f86c-4c25-a311-31488eb391e3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:38.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:38.768Z InvocationID=173de2f1-8219-45ec-abbc-49e3bdb64c07 2021-07-13T00:22:38.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f4781f00-d38e-4476-a356-92af59a719e2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:38.874Z InvocationID=8acb0472-0e05-48bd-8562-75508bf8f3ca 2021-07-13T00:22:41.479Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cc76d7fd-c737-40c7-b5f2-5b7af62799c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:41.557Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fc4bbc44-f86c-4c25-a311-31488eb391e3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:41.617Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f4781f00-d38e-4476-a356-92af59a719e2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:41.860Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cc76d7fd-c737-40c7-b5f2-5b7af62799c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4419 EndTimestamp=2021-07-13T00:22:41.860Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:37.441Z InvocationID=8555d7a8-dd47-498e-99da-98fafa9ee4d9 ResponseDesc=OK 2021-07-13T00:22:42.014Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fc4bbc44-f86c-4c25-a311-31488eb391e3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3245 EndTimestamp=2021-07-13T00:22:42.013Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:38.768Z InvocationID=5a1f569a-8723-4eed-ac2e-99ae59d38e5c ResponseDesc=OK 2021-07-13T00:22:42.057Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f4781f00-d38e-4476-a356-92af59a719e2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3183 EndTimestamp=2021-07-13T00:22:42.057Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:38.874Z InvocationID=2216595e-07af-4ccc-b6fc-248b7f5189da ResponseDesc=OK 2021-07-13T00:22:42.916Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=841fbb3f-0a23-4109-be02-9a5d1f043e55 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:42.916Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:42.916Z InvocationID=59344da8-f167-4d78-9ccd-e1203407876d 2021-07-13T00:22:43.081Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=841fbb3f-0a23-4109-be02-9a5d1f043e55 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:43.827Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=841fbb3f-0a23-4109-be02-9a5d1f043e55 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=911 EndTimestamp=2021-07-13T00:22:43.827Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:42.916Z InvocationID=ab6c5ba1-2e7e-4dd3-906f-d3bc37120d6b ResponseDesc=OK 2021-07-13T00:22:45.070Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=939636b8-02a5-4e88-99c1-288bf1145ef4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:45.070Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:45.070Z InvocationID=704ad0e0-fd43-4743-976a-2bb273711b5b 2021-07-13T00:22:45.974Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=939636b8-02a5-4e88-99c1-288bf1145ef4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:46.261Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=939636b8-02a5-4e88-99c1-288bf1145ef4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1191 EndTimestamp=2021-07-13T00:22:46.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:45.070Z InvocationID=894949c9-5561-4e65-a1fa-3fa6d46607a0 ResponseDesc=OK 2021-07-13T00:22:47.440Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=37a3ec18-0205-4719-ba3f-352305e7ec94 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:47.440Z InvocationID=e8c97e49-9c9b-41ef-bb04-bf72c19d2c45 2021-07-13T00:22:47.656Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=37a3ec18-0205-4719-ba3f-352305e7ec94 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:47.971Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fe1bc3d8-40d6-4226-90fc-71b3593c31a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:47.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:47.970Z InvocationID=a5483074-a605-421d-8ec1-eddf195ca3ef 2021-07-13T00:22:48.261Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fe1bc3d8-40d6-4226-90fc-71b3593c31a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:48.557Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fe1bc3d8-40d6-4226-90fc-71b3593c31a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=587 EndTimestamp=2021-07-13T00:22:48.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:47.970Z InvocationID=df3fd798-e8b2-41bb-bdbc-eeff979359ac ResponseDesc=OK 2021-07-13T00:22:48.664Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=37a3ec18-0205-4719-ba3f-352305e7ec94 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1224 EndTimestamp=2021-07-13T00:22:48.664Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:47.440Z InvocationID=f8a395c8-37f9-427b-8942-e721c33f6582 ResponseDesc=OK 2021-07-13T00:22:48.874Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d925a5fc-6bed-4294-80a6-c1868eb45c4f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:48.874Z InvocationID=1c391514-1238-48f3-b263-46caa784fc40 2021-07-13T00:22:49.722Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d925a5fc-6bed-4294-80a6-c1868eb45c4f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:50.160Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d925a5fc-6bed-4294-80a6-c1868eb45c4f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1286 EndTimestamp=2021-07-13T00:22:50.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:48.874Z InvocationID=6333eb0b-65ef-4717-929b-5faf578491de ResponseDesc=OK 2021-07-13T00:22:51.164Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=058bba99-fda9-4336-88bd-bfe492170adc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:51.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:51.164Z InvocationID=4d260d16-c4e0-470a-9204-d76257618c55 2021-07-13T00:22:51.757Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=058bba99-fda9-4336-88bd-bfe492170adc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:52.058Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=058bba99-fda9-4336-88bd-bfe492170adc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=894 EndTimestamp=2021-07-13T00:22:52.058Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:51.164Z InvocationID=d5683558-6244-43ca-9082-84ae48482f71 ResponseDesc=OK 2021-07-13T00:22:53.962Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c2daded9-bfc8-4ff3-a054-1fba54c6045f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:53.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:53.962Z InvocationID=2e8049eb-d92e-4715-ae89-8a47883baec2 2021-07-13T00:22:53.987Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c2daded9-bfc8-4ff3-a054-1fba54c6045f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:54.560Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c2daded9-bfc8-4ff3-a054-1fba54c6045f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=598 EndTimestamp=2021-07-13T00:22:54.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:53.962Z InvocationID=d328ca6f-dd80-474d-9c97-7675a07bee08 ResponseDesc=OK 2021-07-13T00:22:56.869Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=37b5fa84-1520-4133-adfc-2a65968b74c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:56.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:56.868Z InvocationID=6ab8aeeb-69c5-458b-96df-eb626080539f 2021-07-13T00:22:57.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7dfc834e-da6f-4864-a54c-351e00ab8f33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:57.440Z InvocationID=a3f3f101-fc99-4efd-8886-b80a3c7ae152 2021-07-13T00:22:57.660Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7dfc834e-da6f-4864-a54c-351e00ab8f33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:57.722Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=37b5fa84-1520-4133-adfc-2a65968b74c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:57.861Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7dfc834e-da6f-4864-a54c-351e00ab8f33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=421 EndTimestamp=2021-07-13T00:22:57.861Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:57.440Z InvocationID=699aeba0-58f8-4c3f-8eff-1fc86f17538b ResponseDesc=OK 2021-07-13T00:22:57.957Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=37b5fa84-1520-4133-adfc-2a65968b74c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1089 EndTimestamp=2021-07-13T00:22:57.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:56.868Z InvocationID=b73887c8-23ff-4c0b-99df-f741f5f088c5 ResponseDesc=OK 2021-07-13T00:22:58.875Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d09a6c33-d310-4627-ae57-21b44d8ee222 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:58.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:58.875Z InvocationID=cd2e6d28-4908-40db-b36e-a6805fa67773 2021-07-13T00:22:59.059Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d09a6c33-d310-4627-ae57-21b44d8ee222 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:22:59.868Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=016362be-7d1a-44be-9ba7-50bee650b03d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:22:59.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:59.868Z InvocationID=f69ea178-e452-43dc-accf-930529394fe0 2021-07-13T00:23:01.114Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d09a6c33-d310-4627-ae57-21b44d8ee222 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2239 EndTimestamp=2021-07-13T00:23:01.114Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:58.875Z InvocationID=d9dad90b-dfc4-4b2b-bf45-67962ed20937 ResponseDesc=OK 2021-07-13T00:23:01.214Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=016362be-7d1a-44be-9ba7-50bee650b03d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:01.460Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=016362be-7d1a-44be-9ba7-50bee650b03d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1592 EndTimestamp=2021-07-13T00:23:01.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:22:59.868Z InvocationID=902ec504-f3bb-4f11-9965-818dd3021231 ResponseDesc=OK 2021-07-13T00:23:02.968Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=20b787e5-d237-43bc-84e8-cdbe505aa04c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:02.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:02.968Z InvocationID=7551a43a-550e-4af3-b757-840a2a99ab78 2021-07-13T00:23:03.061Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=20b787e5-d237-43bc-84e8-cdbe505aa04c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:03.458Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=20b787e5-d237-43bc-84e8-cdbe505aa04c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=489 EndTimestamp=2021-07-13T00:23:03.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:02.968Z InvocationID=977699d6-708b-4495-909b-13306569e726 ResponseDesc=OK 2021-07-13T00:23:05.962Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=978f289f-91ad-4f82-bdc9-e561133cd5fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:05.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:05.961Z InvocationID=5527a23b-1e31-4071-87f1-dc9489045609 2021-07-13T00:23:06.072Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=978f289f-91ad-4f82-bdc9-e561133cd5fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:07.446Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=18113cd9-6dba-4081-9a83-d0144785f035 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:07.446Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:07.446Z InvocationID=acf8353a-0ddb-4a3e-b0f9-a58e159ca148 2021-07-13T00:23:08.314Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=18113cd9-6dba-4081-9a83-d0144785f035 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:08.320Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=978f289f-91ad-4f82-bdc9-e561133cd5fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2358 EndTimestamp=2021-07-13T00:23:08.319Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:05.961Z InvocationID=72c176aa-6ee9-4268-9ed1-975b103b76f8 ResponseDesc=OK 2021-07-13T00:23:08.560Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=18113cd9-6dba-4081-9a83-d0144785f035 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1114 EndTimestamp=2021-07-13T00:23:08.560Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:07.446Z InvocationID=945302f7-ed71-46e5-8f23-8e017efffe55 ResponseDesc=OK 2021-07-13T00:23:08.875Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cc5c9b43-3a11-4d72-948e-8c7226989b22 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:08.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:08.875Z InvocationID=a4d93ac0-b1c6-4dab-9290-b3bc2e101297 2021-07-13T00:23:09.156Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cc5c9b43-3a11-4d72-948e-8c7226989b22 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:09.271Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=01033edc-fea0-46db-a745-5cfab1f2b086 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:09.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:09.271Z InvocationID=a2bce75e-5fff-4268-9444-8a8c2329f35f 2021-07-13T00:23:09.459Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=01033edc-fea0-46db-a745-5cfab1f2b086 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:09.557Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cc5c9b43-3a11-4d72-948e-8c7226989b22 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=682 EndTimestamp=2021-07-13T00:23:09.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:08.875Z InvocationID=6b36765e-839c-49fe-b569-7f81790166c7 ResponseDesc=OK 2021-07-13T00:23:13.402Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=734f558e-9598-42ec-bc32-01064ad887e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:13.402Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:13.402Z InvocationID=fdf52cfb-a4df-4c11-b31f-f22edec5de61 2021-07-13T00:23:15.412Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=734f558e-9598-42ec-bc32-01064ad887e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:15.663Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=734f558e-9598-42ec-bc32-01064ad887e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2261 EndTimestamp=2021-07-13T00:23:15.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:13.402Z InvocationID=2ac49fc9-f2bc-4c3e-8a41-83765168c3bd ResponseDesc=OK 2021-07-13T00:23:15.912Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=01033edc-fea0-46db-a745-5cfab1f2b086 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=6641 EndTimestamp=2021-07-13T00:23:15.912Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:09.271Z InvocationID=9d3cb950-76cb-44c1-92a2-02dcc17a9401 ResponseDesc=OK 2021-07-13T00:23:16.868Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=af3df81e-58bb-4371-b285-9df06a118dfb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:16.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:16.868Z InvocationID=8ca3c892-1dd6-4d70-91a1-b05da5f090f2 2021-07-13T00:23:17.156Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=af3df81e-58bb-4371-b285-9df06a118dfb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:17.442Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7abcb0f5-ddd7-4e55-8fec-fdd09835bc9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:17.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:17.442Z InvocationID=fa1429e6-6193-4943-925f-b3c570a9dec7 2021-07-13T00:23:17.458Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=af3df81e-58bb-4371-b285-9df06a118dfb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=590 EndTimestamp=2021-07-13T00:23:17.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:16.868Z InvocationID=d88c9cbd-480d-4c71-8945-eb66fd044ad5 ResponseDesc=OK 2021-07-13T00:23:17.660Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7abcb0f5-ddd7-4e55-8fec-fdd09835bc9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:18.036Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7abcb0f5-ddd7-4e55-8fec-fdd09835bc9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=594 EndTimestamp=2021-07-13T00:23:18.036Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:17.442Z InvocationID=ef3e4550-f7cd-461b-a91d-b68ade0dc8c1 ResponseDesc=OK 2021-07-13T00:23:18.774Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9b5a4f38-edca-41f2-ac0c-3368613188a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:18.774Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:18.774Z InvocationID=a9fb352d-675b-496a-b56b-a2584a9b6bca 2021-07-13T00:23:18.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0009d973-0daa-4823-a540-552812f29c72 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:18.873Z InvocationID=f163e18d-4c70-4cb6-96cb-dc40150402dd 2021-07-13T00:23:18.959Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9b5a4f38-edca-41f2-ac0c-3368613188a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:18.967Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0009d973-0daa-4823-a540-552812f29c72 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:20.461Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9b5a4f38-edca-41f2-ac0c-3368613188a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1687 EndTimestamp=2021-07-13T00:23:20.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:18.774Z InvocationID=a06709cd-eaee-4334-b0d8-2b25d83f288e ResponseDesc=OK 2021-07-13T00:23:20.657Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0009d973-0daa-4823-a540-552812f29c72 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1784 EndTimestamp=2021-07-13T00:23:20.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:18.873Z InvocationID=182adf5d-7089-4187-a5df-870e55ecb98f ResponseDesc=OK 2021-07-13T00:23:21.572Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2c0b429e-11fd-476c-a25b-6272f603b426 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:21.572Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:21.572Z InvocationID=afe4092b-a8e0-4931-8286-bf1c23c5147c 2021-07-13T00:23:21.762Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2c0b429e-11fd-476c-a25b-6272f603b426 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:22.712Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2c0b429e-11fd-476c-a25b-6272f603b426 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1140 EndTimestamp=2021-07-13T00:23:22.712Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:21.572Z InvocationID=983751b2-3e4d-456d-bb29-ea34a9bc31cb ResponseDesc=OK 2021-07-13T00:23:23.764Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8ce64d1c-4320-4bdd-be58-fe0ccae721b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:23.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:23.764Z InvocationID=63091396-9d72-448d-aad3-5bbe33508c1a 2021-07-13T00:23:24.723Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8ce64d1c-4320-4bdd-be58-fe0ccae721b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:27.441Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b7f9fbf4-6258-4644-8de9-cb9b29ffc539 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:27.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:27.441Z InvocationID=dbf6d92e-30eb-4f4a-a13a-cb86b7d27fe6 2021-07-13T00:23:27.560Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b7f9fbf4-6258-4644-8de9-cb9b29ffc539 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:28.001Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e91c7dd4-9947-4c19-9a85-05410fa77688 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:28.001Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:28.001Z InvocationID=5ea545c8-68ee-4351-9d56-da12563f8315 2021-07-13T00:23:28.160Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e91c7dd4-9947-4c19-9a85-05410fa77688 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:28.161Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8ce64d1c-4320-4bdd-be58-fe0ccae721b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4396 EndTimestamp=2021-07-13T00:23:28.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:23.764Z InvocationID=3e5c769d-03e3-4073-a476-f153fdb8c07d ResponseDesc=OK 2021-07-13T00:23:28.358Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e91c7dd4-9947-4c19-9a85-05410fa77688 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=357 EndTimestamp=2021-07-13T00:23:28.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:28.001Z InvocationID=b16b6f7c-7ce0-42a0-a69c-4cf70402ab82 ResponseDesc=OK 2021-07-13T00:23:28.620Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b7f9fbf4-6258-4644-8de9-cb9b29ffc539 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1179 EndTimestamp=2021-07-13T00:23:28.620Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:27.441Z InvocationID=f58afd8e-03d7-46cf-a701-fb3feeca5d3e ResponseDesc=OK 2021-07-13T00:23:28.874Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4673cb58-385f-4342-a4cf-5b43e9af83fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:28.874Z InvocationID=6e4a479b-c123-4061-99b7-07b0ab30977e 2021-07-13T00:23:29.815Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4673cb58-385f-4342-a4cf-5b43e9af83fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:29.962Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9014cf87-d030-4747-bf78-4e822ade56df InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:29.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:29.962Z InvocationID=be8bd546-7546-4bf5-a7b8-7080d1daaf48 2021-07-13T00:23:30.057Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9014cf87-d030-4747-bf78-4e822ade56df InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:30.459Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4673cb58-385f-4342-a4cf-5b43e9af83fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1585 EndTimestamp=2021-07-13T00:23:30.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:28.874Z InvocationID=379365e9-a728-4c0c-a35f-697e16d1cbb7 ResponseDesc=OK 2021-07-13T00:23:30.857Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9014cf87-d030-4747-bf78-4e822ade56df InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=895 EndTimestamp=2021-07-13T00:23:30.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:29.962Z InvocationID=9606b221-e7f5-4fd5-927e-cebd43adca33 ResponseDesc=OK 2021-07-13T00:23:32.875Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b66c61e8-db33-47d0-949b-d1b3d52f35ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:32.875Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:32.875Z InvocationID=b5094c5d-652a-476d-95ba-8bc1cbad93fa 2021-07-13T00:23:33.159Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b66c61e8-db33-47d0-949b-d1b3d52f35ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:33.426Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b66c61e8-db33-47d0-949b-d1b3d52f35ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=551 EndTimestamp=2021-07-13T00:23:33.426Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:32.875Z InvocationID=8c15aec0-be39-4354-bd4d-8339f90bdfd9 ResponseDesc=OK 2021-07-13T00:23:35.873Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=baf83167-33c2-49cb-b848-29fcdc8e50a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:35.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:35.873Z InvocationID=bf0775b5-0328-4f12-b29d-4893f4a34a30 2021-07-13T00:23:36.517Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=baf83167-33c2-49cb-b848-29fcdc8e50a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:36.859Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=baf83167-33c2-49cb-b848-29fcdc8e50a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=986 EndTimestamp=2021-07-13T00:23:36.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:35.873Z InvocationID=67261fb2-3f98-4645-ab4a-2f36b2b45f98 ResponseDesc=OK 2021-07-13T00:23:37.440Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da925ef9-e212-4611-a407-7c9383931ee2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:37.439Z InvocationID=cfdc3ea5-2fcc-452e-86a9-c4743d9bdfc9 2021-07-13T00:23:37.558Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da925ef9-e212-4611-a407-7c9383931ee2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:38.158Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da925ef9-e212-4611-a407-7c9383931ee2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=719 EndTimestamp=2021-07-13T00:23:38.158Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:37.439Z InvocationID=c671f8a4-f02c-4a82-b0f8-c79e4f9c6d96 ResponseDesc=OK 2021-07-13T00:23:38.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=023000ad-0033-476c-983e-249d55733329 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:38.874Z InvocationID=cede19a8-bcc5-494b-8a9a-41ca72877bd9 2021-07-13T00:23:39.062Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=023000ad-0033-476c-983e-249d55733329 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:39.072Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d5761268-1cf5-4c94-9cf3-c1c4a4b5d3e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:39.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:39.072Z InvocationID=82ef27f2-b512-4e77-8ed3-f6f1c0cea4e2 2021-07-13T00:23:39.327Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d5761268-1cf5-4c94-9cf3-c1c4a4b5d3e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:39.540Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=023000ad-0033-476c-983e-249d55733329 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=666 EndTimestamp=2021-07-13T00:23:39.540Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:38.874Z InvocationID=62b5783a-7265-4b02-bf88-448069fbfa42 ResponseDesc=OK 2021-07-13T00:23:39.561Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d5761268-1cf5-4c94-9cf3-c1c4a4b5d3e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=489 EndTimestamp=2021-07-13T00:23:39.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:39.072Z InvocationID=dbfd9459-ac64-441f-8b83-c9347d2b2f4c ResponseDesc=OK 2021-07-13T00:23:41.769Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9023fac5-3d40-4558-983c-fdf816906058 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:41.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:41.769Z InvocationID=8b9db7f0-e979-4d90-a702-d0533f2a6b14 2021-07-13T00:23:44.557Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9023fac5-3d40-4558-983c-fdf816906058 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:45.261Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9023fac5-3d40-4558-983c-fdf816906058 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3492 EndTimestamp=2021-07-13T00:23:45.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:41.769Z InvocationID=c91f2f9f-8e80-497c-9015-52172f990050 ResponseDesc=OK 2021-07-13T00:23:46.219Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e9c405b9-7a27-4fb6-b00d-aa360dadeac3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:46.219Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:46.219Z InvocationID=9e2f78bf-ce87-49f7-ad80-69d906791399 2021-07-13T00:23:46.359Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e9c405b9-7a27-4fb6-b00d-aa360dadeac3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:47.014Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e9c405b9-7a27-4fb6-b00d-aa360dadeac3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=795 EndTimestamp=2021-07-13T00:23:47.014Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:46.219Z InvocationID=d9a7ad5c-7282-47ec-8cac-21d8fc7f73c1 ResponseDesc=OK 2021-07-13T00:23:47.441Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=834dda1b-e39d-404d-9e89-f15304f7db66 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:47.440Z InvocationID=95b220ef-31dc-43c8-88f5-e49abb0c9828 2021-07-13T00:23:47.715Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=834dda1b-e39d-404d-9e89-f15304f7db66 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:47.960Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=834dda1b-e39d-404d-9e89-f15304f7db66 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=520 EndTimestamp=2021-07-13T00:23:47.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:47.440Z InvocationID=84e7a13a-e31a-43b6-89ec-d063183f1327 ResponseDesc=OK 2021-07-13T00:23:48.372Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7de868f5-956d-4a3a-a662-525a7a1c024d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:48.372Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:48.372Z InvocationID=4d0ac92e-bf04-40dd-b0bb-a3bad8442dc3 2021-07-13T00:23:48.556Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7de868f5-956d-4a3a-a662-525a7a1c024d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:48.874Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9368ca07-c02e-45fb-9e26-c1efa480f426 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:48.874Z InvocationID=79e81fd8-10b0-49dd-9c0b-ac60d335f89a 2021-07-13T00:23:48.958Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7de868f5-956d-4a3a-a662-525a7a1c024d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=586 EndTimestamp=2021-07-13T00:23:48.958Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:48.372Z InvocationID=fe6ccf4d-6086-42b6-8eb4-dc8edb343a69 ResponseDesc=OK 2021-07-13T00:23:49.059Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9368ca07-c02e-45fb-9e26-c1efa480f426 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:49.420Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9368ca07-c02e-45fb-9e26-c1efa480f426 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=546 EndTimestamp=2021-07-13T00:23:49.420Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:48.874Z InvocationID=2e9983fe-f190-464d-8ea2-1e2ed8fdc928 ResponseDesc=OK 2021-07-13T00:23:50.965Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d124f8ee-b73e-4112-93e6-3342ff325620 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:50.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:50.965Z InvocationID=f7ef4d19-7d8c-4526-bc9b-e0b38fa9858d 2021-07-13T00:23:51.717Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d124f8ee-b73e-4112-93e6-3342ff325620 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:51.963Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d124f8ee-b73e-4112-93e6-3342ff325620 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=998 EndTimestamp=2021-07-13T00:23:51.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:50.965Z InvocationID=86d50d7e-ba27-47a0-bb94-7b6bbd5da521 ResponseDesc=OK 2021-07-13T00:23:53.968Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ffac088c-d27c-46d1-9bf8-442ee3e15e56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:53.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:53.967Z InvocationID=7010dd1a-9c80-42d3-a629-12d34c02736a 2021-07-13T00:23:54.158Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ffac088c-d27c-46d1-9bf8-442ee3e15e56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:54.958Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ffac088c-d27c-46d1-9bf8-442ee3e15e56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=991 EndTimestamp=2021-07-13T00:23:54.958Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:53.967Z InvocationID=b3c79eb9-fb95-41ac-979c-ade991240f12 ResponseDesc=OK 2021-07-13T00:23:56.672Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c08a147b-0f04-48a0-a85f-53ae58911675 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:56.672Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:56.672Z InvocationID=ca420139-6deb-4381-9757-385cca2786e6 2021-07-13T00:23:56.964Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c08a147b-0f04-48a0-a85f-53ae58911675 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:57.167Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c08a147b-0f04-48a0-a85f-53ae58911675 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:23:57.167Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:56.672Z InvocationID=d6da9ec4-695c-4d41-9f12-06b4402fb96b ResponseDesc=OK 2021-07-13T00:23:57.440Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4d8c7af3-cd9a-41f6-8402-93fae41e7051 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:57.440Z InvocationID=5c516452-0d67-4490-bd81-3d94a431fc32 2021-07-13T00:23:57.570Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4d8c7af3-cd9a-41f6-8402-93fae41e7051 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:57.759Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4d8c7af3-cd9a-41f6-8402-93fae41e7051 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=319 EndTimestamp=2021-07-13T00:23:57.759Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:57.440Z InvocationID=2d3300aa-8ffb-465a-9a32-c6230efff7c0 ResponseDesc=OK 2021-07-13T00:23:58.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=78bb22d0-69a9-4603-94ca-3ac0b9d379f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:23:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:58.873Z InvocationID=36fe4290-3b57-4d34-9063-47fb57e03c5b 2021-07-13T00:23:59.060Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=78bb22d0-69a9-4603-94ca-3ac0b9d379f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:23:59.758Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=78bb22d0-69a9-4603-94ca-3ac0b9d379f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=884 EndTimestamp=2021-07-13T00:23:59.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:23:58.873Z InvocationID=703f4dc2-21b5-4bd7-a96c-a9705c7aacc4 ResponseDesc=OK 2021-07-13T00:24:00.463Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cdc166b3-e999-4976-bc84-0a42a9f33c0c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:00.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:00.463Z InvocationID=7ab0cc5c-d5bc-4ed3-aab7-987f3e19c85a 2021-07-13T00:24:00.560Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cdc166b3-e999-4976-bc84-0a42a9f33c0c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:00.778Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cdc166b3-e999-4976-bc84-0a42a9f33c0c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=315 EndTimestamp=2021-07-13T00:24:00.778Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:00.463Z InvocationID=c1200bb7-3460-4929-8f07-c0957e1de377 ResponseDesc=OK 2021-07-13T00:24:02.970Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=249a24b9-14da-405b-b24a-7a2f9847fc9e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:02.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:02.970Z InvocationID=9e0a45c3-42ab-4190-97c6-c74acef75477 2021-07-13T00:24:03.270Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=249a24b9-14da-405b-b24a-7a2f9847fc9e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:03.959Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=249a24b9-14da-405b-b24a-7a2f9847fc9e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=989 EndTimestamp=2021-07-13T00:24:03.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:02.970Z InvocationID=990ab5b7-4027-461d-baa2-61d94f76ec51 ResponseDesc=OK 2021-07-13T00:24:05.678Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d4418eb9-6d9a-4ec8-9524-c65508ae4556 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:05.677Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:05.677Z InvocationID=5298693c-38f4-4dfe-b69b-7169fa56425d 2021-07-13T00:24:05.956Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d4418eb9-6d9a-4ec8-9524-c65508ae4556 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:06.269Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d4418eb9-6d9a-4ec8-9524-c65508ae4556 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=592 EndTimestamp=2021-07-13T00:24:06.269Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:05.677Z InvocationID=7c9993db-3c30-45a4-8fa1-a8e1a41a2298 ResponseDesc=OK 2021-07-13T00:24:07.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e805f067-1542-4596-89ba-d8691a520e28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:07.440Z InvocationID=7bbdfa62-32e0-41c0-a6dd-8a009eff7d42 2021-07-13T00:24:07.571Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e805f067-1542-4596-89ba-d8691a520e28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:07.963Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e805f067-1542-4596-89ba-d8691a520e28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=523 EndTimestamp=2021-07-13T00:24:07.963Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:07.440Z InvocationID=37b70fa9-09f2-4f2b-bff1-1303ae0f7cb7 ResponseDesc=OK 2021-07-13T00:24:08.873Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f6dc357e-252f-47a2-9e6a-7eeeb835fb13 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:08.873Z InvocationID=9c280d3b-8131-41e9-96cb-360c1d66e0fe 2021-07-13T00:24:08.970Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5dbd49ee-24ff-472f-9069-580391fd2ae6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:08.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:08.970Z InvocationID=d6d43c9f-86e3-45b7-aaf0-b8023c24d0ec 2021-07-13T00:24:09.262Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5dbd49ee-24ff-472f-9069-580391fd2ae6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:09.266Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f6dc357e-252f-47a2-9e6a-7eeeb835fb13 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:09.661Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5dbd49ee-24ff-472f-9069-580391fd2ae6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=691 EndTimestamp=2021-07-13T00:24:09.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:08.970Z InvocationID=36cc71fd-d81e-4755-9dbb-636b6422eb08 ResponseDesc=OK 2021-07-13T00:24:09.963Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f6dc357e-252f-47a2-9e6a-7eeeb835fb13 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1090 EndTimestamp=2021-07-13T00:24:09.963Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:08.873Z InvocationID=38f562a9-3b3b-486b-9b12-9b98629fe45f ResponseDesc=OK 2021-07-13T00:24:12.564Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d043852-766b-4b1e-a091-ffe9bb221233 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:12.563Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:12.563Z InvocationID=f9526feb-535c-440c-a1f6-86f628cb20a9 2021-07-13T00:24:12.659Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d043852-766b-4b1e-a091-ffe9bb221233 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:13.565Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d043852-766b-4b1e-a091-ffe9bb221233 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1002 EndTimestamp=2021-07-13T00:24:13.565Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:12.563Z InvocationID=b124a00a-8b4d-4923-8a0f-acc4109ecf5d ResponseDesc=OK 2021-07-13T00:24:14.871Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e8ecf9d0-e84b-48c0-b331-5083ee6e07ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:14.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:14.871Z InvocationID=d1c380e7-f2bf-46db-ba5e-f4b71c64f7fa 2021-07-13T00:24:15.060Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e8ecf9d0-e84b-48c0-b331-5083ee6e07ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:15.260Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e8ecf9d0-e84b-48c0-b331-5083ee6e07ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=389 EndTimestamp=2021-07-13T00:24:15.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:14.871Z InvocationID=e5caa730-8227-4d53-a5a2-1dc591e87b41 ResponseDesc=OK 2021-07-13T00:24:17.445Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=09df32ce-992b-43a9-b11d-a646dc402613 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:17.445Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:17.445Z InvocationID=b6fadc47-569d-4337-97c9-f6833ee43373 2021-07-13T00:24:17.557Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=09df32ce-992b-43a9-b11d-a646dc402613 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:17.560Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a0eb8132-ca8d-49f6-8de1-a1926c6dac36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:17.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:17.560Z InvocationID=e95ab0da-14f2-4d7a-bf1b-6106639da81c 2021-07-13T00:24:17.571Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a0eb8132-ca8d-49f6-8de1-a1926c6dac36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:17.672Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=09df32ce-992b-43a9-b11d-a646dc402613 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=226 EndTimestamp=2021-07-13T00:24:17.671Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:17.445Z InvocationID=3f8e2308-a8a5-45d0-a2f6-8da7748638d0 ResponseDesc=OK 2021-07-13T00:24:17.759Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a0eb8132-ca8d-49f6-8de1-a1926c6dac36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=199 EndTimestamp=2021-07-13T00:24:17.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:17.560Z InvocationID=7923979d-acad-47f5-91b9-2dd1deed0208 ResponseDesc=OK 2021-07-13T00:24:18.873Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=765432da-c865-45b7-91a8-329917fb1468 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:18.873Z InvocationID=fb2bacfb-a419-402b-97a1-e020a9c0ec63 2021-07-13T00:24:18.960Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=765432da-c865-45b7-91a8-329917fb1468 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:19.059Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=765432da-c865-45b7-91a8-329917fb1468 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=186 EndTimestamp=2021-07-13T00:24:19.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:18.873Z InvocationID=2b80ab7d-6827-4c61-b2e0-3bb4529c2e88 ResponseDesc=OK 2021-07-13T00:24:20.764Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=933a12a6-2f9e-49ee-9277-c85dc1271673 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:20.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:20.763Z InvocationID=c0e1d35b-fe5f-420f-bfff-352158432972 2021-07-13T00:24:20.859Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=933a12a6-2f9e-49ee-9277-c85dc1271673 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:21.158Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=933a12a6-2f9e-49ee-9277-c85dc1271673 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=395 EndTimestamp=2021-07-13T00:24:21.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:20.763Z InvocationID=d1693777-5992-41dc-9030-b5708d73ee25 ResponseDesc=OK 2021-07-13T00:24:23.665Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=20b66d31-09aa-455e-80be-129d9ee52f00 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:23.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:23.665Z InvocationID=c269724f-99c7-46e5-bcf7-88d0d661a579 2021-07-13T00:24:23.760Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=20b66d31-09aa-455e-80be-129d9ee52f00 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:23.963Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=20b66d31-09aa-455e-80be-129d9ee52f00 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=298 EndTimestamp=2021-07-13T00:24:23.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:23.665Z InvocationID=80ddd063-2985-4918-981a-d69626ea43fb ResponseDesc=OK 2021-07-13T00:24:26.972Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9f16ebee-6a64-4d50-9643-f90961fd8a66 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:26.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:26.972Z InvocationID=1482b4b9-4917-47ea-992f-c8a8c4e83a78 2021-07-13T00:24:27.060Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9f16ebee-6a64-4d50-9643-f90961fd8a66 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:27.171Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9f16ebee-6a64-4d50-9643-f90961fd8a66 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=199 EndTimestamp=2021-07-13T00:24:27.171Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:26.972Z InvocationID=1dc9cb7f-5d10-4edc-aeb6-06200d80812e ResponseDesc=OK 2021-07-13T00:24:27.440Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5fdc3352-7c2f-4f57-8049-e312fce888a0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:27.440Z InvocationID=6b5ce3b7-5b20-42e0-9067-1069229aa787 2021-07-13T00:24:27.470Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5fdc3352-7c2f-4f57-8049-e312fce888a0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:27.857Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5fdc3352-7c2f-4f57-8049-e312fce888a0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=417 EndTimestamp=2021-07-13T00:24:27.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:27.440Z InvocationID=55d869ba-d373-4895-9740-d69114cfaefe ResponseDesc=OK 2021-07-13T00:24:28.875Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3bea336c-63e0-4f7e-9349-f042ce75b746 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:28.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:28.875Z InvocationID=4931946f-5b4a-4bf5-bcd8-91aa84892ab0 2021-07-13T00:24:29.059Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3bea336c-63e0-4f7e-9349-f042ce75b746 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:29.316Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3bea336c-63e0-4f7e-9349-f042ce75b746 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=441 EndTimestamp=2021-07-13T00:24:29.316Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:28.875Z InvocationID=5f03e5d7-c0fe-430c-9c07-23c3070525c2 ResponseDesc=OK 2021-07-13T00:24:29.769Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4e8bd5f1-05fe-4562-9299-b3bf72379a78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:29.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:29.769Z InvocationID=49d1614f-fea4-4553-9cdf-197baa83e879 2021-07-13T00:24:30.011Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4e8bd5f1-05fe-4562-9299-b3bf72379a78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:30.170Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4e8bd5f1-05fe-4562-9299-b3bf72379a78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=401 EndTimestamp=2021-07-13T00:24:30.170Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:29.769Z InvocationID=90196ca5-40bc-4c38-ace0-189164673b66 ResponseDesc=OK 2021-07-13T00:24:32.862Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=94a9283e-93aa-47d0-bb56-0acec80b9852 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:32.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:32.862Z InvocationID=df984637-9bee-47da-aa0c-68419c11d866 2021-07-13T00:24:32.964Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=94a9283e-93aa-47d0-bb56-0acec80b9852 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:33.357Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=94a9283e-93aa-47d0-bb56-0acec80b9852 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:24:33.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:32.862Z InvocationID=37507464-af98-4126-bfcb-a4a7eafe0188 ResponseDesc=OK 2021-07-13T00:24:35.771Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d6bdc995-9b4f-4ceb-b692-a865fca80f73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:35.771Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:35.771Z InvocationID=23f7381e-cece-44ea-8b49-d2b1ed155c15 2021-07-13T00:24:35.867Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d6bdc995-9b4f-4ceb-b692-a865fca80f73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:36.267Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d6bdc995-9b4f-4ceb-b692-a865fca80f73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:24:36.267Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:35.771Z InvocationID=fa5dc7b9-51ff-446e-a55e-0211b5d59ff6 ResponseDesc=OK 2021-07-13T00:24:37.444Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=77a3035c-4f57-47f0-b0e9-19b520206eec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:37.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:37.444Z InvocationID=6ab3f4eb-a0c3-41c1-8de8-253a1058825c 2021-07-13T00:24:38.764Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=99d3c4a9-e04c-43b0-9709-e2acdd5eb2d8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:38.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:38.763Z InvocationID=c9bf8b79-7797-4d44-917c-a594091f7a3d 2021-07-13T00:24:38.874Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f274cb4d-890a-4962-bea3-d40cb3dc23a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:38.874Z InvocationID=a7194811-b725-4e2d-a04f-75ea31ee2451 2021-07-13T00:24:40.660Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=99d3c4a9-e04c-43b0-9709-e2acdd5eb2d8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:40.757Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f274cb4d-890a-4962-bea3-d40cb3dc23a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:40.814Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=77a3035c-4f57-47f0-b0e9-19b520206eec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:40.959Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f274cb4d-890a-4962-bea3-d40cb3dc23a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2085 EndTimestamp=2021-07-13T00:24:40.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:38.874Z InvocationID=9d62d6af-a01f-4b0b-9d6d-afa68aa601f1 ResponseDesc=OK 2021-07-13T00:24:41.057Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=99d3c4a9-e04c-43b0-9709-e2acdd5eb2d8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2294 EndTimestamp=2021-07-13T00:24:41.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:38.763Z InvocationID=5ec636b6-fd3c-4938-9efd-bff02c1049fc ResponseDesc=OK 2021-07-13T00:24:41.515Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=77a3035c-4f57-47f0-b0e9-19b520206eec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4071 EndTimestamp=2021-07-13T00:24:41.515Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:37.444Z InvocationID=dee3f410-d3e3-42f4-8ae8-7b160ec3fbf7 ResponseDesc=OK 2021-07-13T00:24:42.066Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7cab4600-2db7-4a7d-9a24-413cfa6f252f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:42.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:42.066Z InvocationID=3b641c1d-cb1a-4ba8-bd6f-d31ca28183a5 2021-07-13T00:24:42.320Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7cab4600-2db7-4a7d-9a24-413cfa6f252f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:42.753Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7cab4600-2db7-4a7d-9a24-413cfa6f252f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=687 EndTimestamp=2021-07-13T00:24:42.753Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:42.066Z InvocationID=dbac4aef-1f65-4cb1-8197-898504b7fd0f ResponseDesc=OK 2021-07-13T00:24:44.874Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b48a68c0-5d81-4c71-a332-ea7b8667cf38 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:44.874Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:44.874Z InvocationID=8edf6afc-6956-452e-a7b0-ca4caa8a8728 2021-07-13T00:24:45.057Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b48a68c0-5d81-4c71-a332-ea7b8667cf38 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:45.357Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b48a68c0-5d81-4c71-a332-ea7b8667cf38 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=483 EndTimestamp=2021-07-13T00:24:45.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:44.874Z InvocationID=6ce76c2d-b6c6-4992-a860-d856d9edebaa ResponseDesc=OK 2021-07-13T00:24:47.440Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aa7f667a-5e27-4886-badb-cd77c8b41d7c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:47.440Z InvocationID=d3fdb939-d025-4f64-9072-26922478b95d 2021-07-13T00:24:47.611Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aa7f667a-5e27-4886-badb-cd77c8b41d7c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:47.931Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aa7f667a-5e27-4886-badb-cd77c8b41d7c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=491 EndTimestamp=2021-07-13T00:24:47.931Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:47.440Z InvocationID=0263f78d-eea3-4e27-9ddb-7a8125ad51a5 ResponseDesc=OK 2021-07-13T00:24:48.070Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5b2af1c9-ff92-4af3-85b9-83c926e082f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:48.070Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:48.070Z InvocationID=16c5d654-c390-49eb-8962-3a608b981d05 2021-07-13T00:24:48.874Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b1d2cc61-af56-49c2-aff9-ee6120c288cd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:48.873Z InvocationID=b4c38042-8177-47bb-b176-4bc32e9c604c 2021-07-13T00:24:50.261Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b1d2cc61-af56-49c2-aff9-ee6120c288cd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:50.317Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5b2af1c9-ff92-4af3-85b9-83c926e082f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:50.467Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b1d2cc61-af56-49c2-aff9-ee6120c288cd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1594 EndTimestamp=2021-07-13T00:24:50.467Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:48.873Z InvocationID=2ad86240-14f4-4979-8c80-276efba30a20 ResponseDesc=OK 2021-07-13T00:24:50.658Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5b2af1c9-ff92-4af3-85b9-83c926e082f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2587 EndTimestamp=2021-07-13T00:24:50.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:48.070Z InvocationID=53e76289-678a-468a-8d4b-086c15a73ef9 ResponseDesc=OK 2021-07-13T00:24:51.568Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9e2273ed-cc3c-4ccf-929b-764f1319b339 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:51.568Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:51.568Z InvocationID=aada150a-9d55-4733-b310-6e3a8c71bdb8 2021-07-13T00:24:51.659Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9e2273ed-cc3c-4ccf-929b-764f1319b339 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:52.016Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9e2273ed-cc3c-4ccf-929b-764f1319b339 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=447 EndTimestamp=2021-07-13T00:24:52.015Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:51.568Z InvocationID=3e03b950-7b0f-4b45-8e86-66a31ef87929 ResponseDesc=OK 2021-07-13T00:24:53.763Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=08619893-87de-43e9-9a23-3e02036778e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:53.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:53.763Z InvocationID=efdc6be3-d7d9-4ada-ad6b-bb3e77f2e717 2021-07-13T00:24:54.371Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=08619893-87de-43e9-9a23-3e02036778e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:54.468Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=08619893-87de-43e9-9a23-3e02036778e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=705 EndTimestamp=2021-07-13T00:24:54.468Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:53.763Z InvocationID=1b7a3f14-5b04-486e-baa4-8d5e0c2fff06 ResponseDesc=OK 2021-07-13T00:24:56.760Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1cbe749c-f2a8-4fd9-8f1a-40dba68f8f32 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:56.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:56.760Z InvocationID=5bbb7e52-6e87-431c-aaa1-68299faa8e43 2021-07-13T00:24:56.956Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1cbe749c-f2a8-4fd9-8f1a-40dba68f8f32 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:57.157Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1cbe749c-f2a8-4fd9-8f1a-40dba68f8f32 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=397 EndTimestamp=2021-07-13T00:24:57.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:56.760Z InvocationID=5a48c938-11b5-4aa3-9089-66091e3a59b9 ResponseDesc=OK 2021-07-13T00:24:57.440Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ab5783e1-c48b-4114-b614-a493acf3ce52 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:57.440Z InvocationID=02a2a299-60ae-41dc-9212-2c73b90c8488 2021-07-13T00:24:57.559Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ab5783e1-c48b-4114-b614-a493acf3ce52 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:57.766Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ab5783e1-c48b-4114-b614-a493acf3ce52 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=326 EndTimestamp=2021-07-13T00:24:57.766Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:57.440Z InvocationID=9f3d08cd-028f-407e-b02f-c04000c379b6 ResponseDesc=OK 2021-07-13T00:24:58.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b44db96f-2348-4e2e-b405-35c3e0a2b2fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:58.873Z InvocationID=18e8ae9a-1023-41ea-9239-6a93c26a2b6b 2021-07-13T00:24:59.114Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b44db96f-2348-4e2e-b405-35c3e0a2b2fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:24:59.359Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b44db96f-2348-4e2e-b405-35c3e0a2b2fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:24:59.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:58.873Z InvocationID=f63c4ea3-928c-47cd-b6be-fffc9b799a31 ResponseDesc=OK 2021-07-13T00:24:59.966Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=238bbf69-a9d1-4f45-98d7-47be5c3cdaeb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:24:59.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:59.966Z InvocationID=18e42a6c-c12f-4524-ac2f-57d546d1b111 2021-07-13T00:25:00.061Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=238bbf69-a9d1-4f45-98d7-47be5c3cdaeb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:00.457Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=238bbf69-a9d1-4f45-98d7-47be5c3cdaeb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=491 EndTimestamp=2021-07-13T00:25:00.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:24:59.966Z InvocationID=7caad28d-6724-4ea8-9696-b3074bc38e20 ResponseDesc=OK 2021-07-13T00:25:03.061Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1c2b4d4f-2a57-4a89-b28d-b07b3760234c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:03.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:03.061Z InvocationID=e0fbaf94-6234-4196-99c1-1062187d16cb 2021-07-13T00:25:03.858Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1c2b4d4f-2a57-4a89-b28d-b07b3760234c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:04.124Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1c2b4d4f-2a57-4a89-b28d-b07b3760234c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1063 EndTimestamp=2021-07-13T00:25:04.124Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:03.061Z InvocationID=d11fe192-614c-45eb-97be-fcc07bb06414 ResponseDesc=OK 2021-07-13T00:25:05.974Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=42927575-0d02-4c70-bc74-e02dd8ea56a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:05.973Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:05.973Z InvocationID=b6a80bc5-cd2b-48e1-b159-22604c8a6aa0 2021-07-13T00:25:06.542Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=42927575-0d02-4c70-bc74-e02dd8ea56a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:06.761Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=42927575-0d02-4c70-bc74-e02dd8ea56a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=788 EndTimestamp=2021-07-13T00:25:06.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:05.973Z InvocationID=c843ebca-1143-4356-9711-3249fbcd3c45 ResponseDesc=OK 2021-07-13T00:25:07.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aa5fa58e-3dc1-4f45-9b56-6a8cc0acdbc5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:07.439Z InvocationID=30a80a74-c263-447b-b73f-0f29fe41c8a2 2021-07-13T00:25:07.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aa5fa58e-3dc1-4f45-9b56-6a8cc0acdbc5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:07.868Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aa5fa58e-3dc1-4f45-9b56-6a8cc0acdbc5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=429 EndTimestamp=2021-07-13T00:25:07.868Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:07.439Z InvocationID=abb6521e-1984-4f53-9750-d93cd4d51bbb ResponseDesc=OK 2021-07-13T00:25:08.667Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=944269df-be08-4b78-ada1-d3c6360d047e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:08.667Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:08.667Z InvocationID=443ef353-4095-43e1-b591-ec3664f81f85 2021-07-13T00:25:08.760Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=944269df-be08-4b78-ada1-d3c6360d047e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:08.874Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d6f5d085-620b-470f-9bb3-673d5ff505f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:08.874Z InvocationID=884f3f0e-b29f-464f-850c-e7df31e3b819 2021-07-13T00:25:09.539Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=944269df-be08-4b78-ada1-d3c6360d047e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=871 EndTimestamp=2021-07-13T00:25:09.538Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:08.667Z InvocationID=60fc3464-9b83-4aa8-8fdf-9ca1c27a0217 ResponseDesc=OK 2021-07-13T00:25:09.725Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d6f5d085-620b-470f-9bb3-673d5ff505f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:11.664Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7ea26356-4084-4f06-bf99-b23507f28b71 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:11.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:11.663Z InvocationID=97dd3ffe-86f1-4607-9b0c-8b5568956785 2021-07-13T00:25:13.557Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7ea26356-4084-4f06-bf99-b23507f28b71 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:13.559Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d6f5d085-620b-470f-9bb3-673d5ff505f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4685 EndTimestamp=2021-07-13T00:25:13.559Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:08.874Z InvocationID=a348c18e-7755-479e-8f1e-e44f4d4423ca ResponseDesc=OK 2021-07-13T00:25:13.958Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7ea26356-4084-4f06-bf99-b23507f28b71 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2294 EndTimestamp=2021-07-13T00:25:13.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:11.663Z InvocationID=61ac6e40-d63b-464c-9b17-f5604f76acb4 ResponseDesc=OK 2021-07-13T00:25:15.064Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d5848903-4565-4890-b8e9-b00f97e18236 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:15.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:15.064Z InvocationID=f58391bd-06d8-4bc6-a1d7-25bd79546665 2021-07-13T00:25:15.259Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d5848903-4565-4890-b8e9-b00f97e18236 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:15.512Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d5848903-4565-4890-b8e9-b00f97e18236 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=448 EndTimestamp=2021-07-13T00:25:15.512Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:15.064Z InvocationID=f285343d-0d42-450e-b24f-7a6c63fa17c2 ResponseDesc=OK 2021-07-13T00:25:17.440Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3391ddfe-9e3d-4312-b804-93e4c26a473e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:17.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:17.440Z InvocationID=ee8966b8-0b2b-41e9-9bb7-9563086d760e 2021-07-13T00:25:17.676Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bd1e4acd-95f1-4520-9a18-fac5c3d9de12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:17.676Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:17.676Z InvocationID=61c47fa1-8e95-438a-9c35-ae81cbc2cf16 2021-07-13T00:25:17.960Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bd1e4acd-95f1-4520-9a18-fac5c3d9de12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:18.019Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3391ddfe-9e3d-4312-b804-93e4c26a473e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:18.161Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bd1e4acd-95f1-4520-9a18-fac5c3d9de12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=485 EndTimestamp=2021-07-13T00:25:18.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:17.676Z InvocationID=85f1962c-43f7-40e7-a585-f0984ab3d982 ResponseDesc=OK 2021-07-13T00:25:18.758Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3391ddfe-9e3d-4312-b804-93e4c26a473e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1318 EndTimestamp=2021-07-13T00:25:18.758Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:17.440Z InvocationID=ccb12b8d-49df-4d02-bfb3-1cb689a3a0fd ResponseDesc=OK 2021-07-13T00:25:18.875Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a6cb885a-022d-45b8-afd3-d3aaccb0eb5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:18.874Z InvocationID=417157eb-5f03-43e3-b19c-85a13dae967e 2021-07-13T00:25:19.160Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a6cb885a-022d-45b8-afd3-d3aaccb0eb5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:19.428Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a6cb885a-022d-45b8-afd3-d3aaccb0eb5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=554 EndTimestamp=2021-07-13T00:25:19.428Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:18.874Z InvocationID=14e59238-74fa-4040-8b31-919ede22a589 ResponseDesc=OK 2021-07-13T00:25:21.364Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c5b8a0c1-f882-408b-a5fd-92a4f0f0db8b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:21.364Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:21.364Z InvocationID=85a70692-73cf-4bb5-a555-44302e8c9162 2021-07-13T00:25:21.560Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c5b8a0c1-f882-408b-a5fd-92a4f0f0db8b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:21.759Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c5b8a0c1-f882-408b-a5fd-92a4f0f0db8b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=395 EndTimestamp=2021-07-13T00:25:21.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:21.364Z InvocationID=354d6428-2fa5-4759-93f0-6bdaad54c096 ResponseDesc=OK 2021-07-13T00:25:23.464Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=71483a5a-93d0-4d8a-8e1b-9c788bec75d9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:23.464Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:23.464Z InvocationID=b6d75b6d-c981-4311-af75-293e7461da4f 2021-07-13T00:25:23.656Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=71483a5a-93d0-4d8a-8e1b-9c788bec75d9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:24.059Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=71483a5a-93d0-4d8a-8e1b-9c788bec75d9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=595 EndTimestamp=2021-07-13T00:25:24.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:23.464Z InvocationID=51c6f637-4fbb-4d0b-af0f-3230143a0c98 ResponseDesc=OK 2021-07-13T00:25:27.062Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=beb73c5a-75f0-42ff-a755-51387e510f61 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:27.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:27.062Z InvocationID=efcca58d-39b6-44e5-9bf4-4d9faae6ff01 2021-07-13T00:25:27.359Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=beb73c5a-75f0-42ff-a755-51387e510f61 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:27.444Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=695f9d9d-f445-441c-9b3e-7a37059c7052 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:27.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:27.444Z InvocationID=7808e083-d0de-4102-a602-65efd41267b5 2021-07-13T00:25:27.775Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=695f9d9d-f445-441c-9b3e-7a37059c7052 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:27.864Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=beb73c5a-75f0-42ff-a755-51387e510f61 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=801 EndTimestamp=2021-07-13T00:25:27.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:27.062Z InvocationID=6d46ed4f-0a7f-41e0-9e58-5236800d8394 ResponseDesc=OK 2021-07-13T00:25:27.877Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=695f9d9d-f445-441c-9b3e-7a37059c7052 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=433 EndTimestamp=2021-07-13T00:25:27.877Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:27.444Z InvocationID=6441a47f-103e-48ec-81aa-36d94472e364 ResponseDesc=OK 2021-07-13T00:25:28.874Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ea77b102-250f-418e-bd36-10eaf01cf070 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:28.874Z InvocationID=6e97388d-327a-49ea-ba50-59f69e1852a3 2021-07-13T00:25:29.057Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ea77b102-250f-418e-bd36-10eaf01cf070 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:29.262Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ea77b102-250f-418e-bd36-10eaf01cf070 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=388 EndTimestamp=2021-07-13T00:25:29.262Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:28.874Z InvocationID=fb0c9998-760a-4456-aa21-a85712d3b84b ResponseDesc=OK 2021-07-13T00:25:30.069Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=10f9e314-fca6-4122-a97f-3aebac091d8b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:30.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:30.069Z InvocationID=0e9b2f78-4ec3-45ba-97ec-97c7a46e7658 2021-07-13T00:25:30.259Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=10f9e314-fca6-4122-a97f-3aebac091d8b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:30.527Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=10f9e314-fca6-4122-a97f-3aebac091d8b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=458 EndTimestamp=2021-07-13T00:25:30.527Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:30.069Z InvocationID=223b85dc-b7ac-4f0f-9fdb-94cd611de7c6 ResponseDesc=OK 2021-07-13T00:25:32.866Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4680e31a-55a8-4fd2-8185-bfc9111dd6fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:32.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:32.866Z InvocationID=28ee75c5-12e0-4d6a-93c7-63931470a4b6 2021-07-13T00:25:37.118Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=435814ce-db1c-4cd1-b125-0bbcc06ddbe9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:37.118Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:37.118Z InvocationID=761e9286-81da-4244-abe9-96eb6869694c 2021-07-13T00:25:37.441Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=708a7ac1-b19c-40c2-9e20-a5b5d906e750 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:37.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:37.441Z InvocationID=e179d8a6-e3da-4c62-8d62-ebdb05d98a0b 2021-07-13T00:25:38.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6c0c4c5e-e6d4-4af8-9208-933d1abf9197 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:38.874Z InvocationID=f177feed-3967-49c0-baaa-d448f3876e6b 2021-07-13T00:25:41.711Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f1236cb9-a982-4bc4-a89b-0a78c47a781f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:41.711Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:41.711Z InvocationID=b8238fe6-b5d1-44c8-a907-e8ab1f4804e7 2021-07-13T00:25:41.852Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4680e31a-55a8-4fd2-8185-bfc9111dd6fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:41.856Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=708a7ac1-b19c-40c2-9e20-a5b5d906e750 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:41.859Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=435814ce-db1c-4cd1-b125-0bbcc06ddbe9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:41.859Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f1236cb9-a982-4bc4-a89b-0a78c47a781f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:42.014Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6c0c4c5e-e6d4-4af8-9208-933d1abf9197 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:42.061Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=435814ce-db1c-4cd1-b125-0bbcc06ddbe9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4942 EndTimestamp=2021-07-13T00:25:42.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:37.118Z InvocationID=774dcaba-550e-4c6d-94c0-78c604a1f4b2 ResponseDesc=OK 2021-07-13T00:25:42.061Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4680e31a-55a8-4fd2-8185-bfc9111dd6fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=9195 EndTimestamp=2021-07-13T00:25:42.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:32.866Z InvocationID=fd54f43f-951c-455a-8748-5ddbe8284b9b ResponseDesc=OK 2021-07-13T00:25:42.071Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=708a7ac1-b19c-40c2-9e20-a5b5d906e750 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4630 EndTimestamp=2021-07-13T00:25:42.071Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:37.441Z InvocationID=0263cc58-c469-4a17-be07-e85bd2175c62 ResponseDesc=OK 2021-07-13T00:25:42.071Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f1236cb9-a982-4bc4-a89b-0a78c47a781f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=360 EndTimestamp=2021-07-13T00:25:42.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:41.711Z InvocationID=494e55bf-a3f1-4fac-a029-ef99401fb609 ResponseDesc=OK 2021-07-13T00:25:42.257Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6c0c4c5e-e6d4-4af8-9208-933d1abf9197 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3383 EndTimestamp=2021-07-13T00:25:42.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:38.874Z InvocationID=396e259a-c473-4fc4-8ce4-36fe9492a704 ResponseDesc=OK 2021-07-13T00:25:43.164Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=370aa243-badf-4673-bd1b-05194d77879f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:43.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:43.163Z InvocationID=6243dab8-1a11-428d-a858-bc5386a3e806 2021-07-13T00:25:43.259Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=370aa243-badf-4673-bd1b-05194d77879f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:43.616Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=370aa243-badf-4673-bd1b-05194d77879f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=453 EndTimestamp=2021-07-13T00:25:43.616Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:43.163Z InvocationID=f0022d30-3bab-4a8c-8478-74b93406cb85 ResponseDesc=OK 2021-07-13T00:25:44.561Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=51128dbf-e0a2-4364-9cf4-5822a3a65253 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:44.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:44.560Z InvocationID=88926d4c-241f-4ec5-b6df-8cfe284f0376 2021-07-13T00:25:44.711Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=51128dbf-e0a2-4364-9cf4-5822a3a65253 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:44.860Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=51128dbf-e0a2-4364-9cf4-5822a3a65253 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=300 EndTimestamp=2021-07-13T00:25:44.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:44.560Z InvocationID=abdb396a-61ab-46ed-b742-a4cfdb280879 ResponseDesc=OK 2021-07-13T00:25:47.442Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1da79f8a-19e7-459e-93c7-181d59507f3f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:47.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:47.442Z InvocationID=7a2c4315-6592-42a1-bedf-f49ad13e60f6 2021-07-13T00:25:47.557Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1da79f8a-19e7-459e-93c7-181d59507f3f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:47.959Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1da79f8a-19e7-459e-93c7-181d59507f3f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=517 EndTimestamp=2021-07-13T00:25:47.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:47.442Z InvocationID=9b4189b8-adec-4686-ba8d-3d67d32926f2 ResponseDesc=OK 2021-07-13T00:25:47.970Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2e945039-b371-4c3f-bf1a-a35cb2fbb244 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:25:47.970Z ElapsedTime=0 EndTimestamp=2021-07-13T00:25:47.970Z InvocationID=5d35d415-2056-4e83-8dc8-f670b2f44e03 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:25:48.159Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2e945039-b371-4c3f-bf1a-a35cb2fbb244 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:48.514Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2e945039-b371-4c3f-bf1a-a35cb2fbb244 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=544 EndTimestamp=2021-07-13T00:25:48.514Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:47.970Z InvocationID=69570932-311f-4d96-b737-a70523d75aff ResponseDesc=OK 2021-07-13T00:25:48.874Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=71a82b54-d38a-44a3-9a4e-537014ed8932 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:48.874Z InvocationID=014b8907-86af-40f5-a4c1-836d3969e3ea 2021-07-13T00:25:49.111Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=71a82b54-d38a-44a3-9a4e-537014ed8932 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:49.361Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=71a82b54-d38a-44a3-9a4e-537014ed8932 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:25:49.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:48.874Z InvocationID=85343965-9513-4b37-88dd-fd4c103b32d5 ResponseDesc=OK 2021-07-13T00:25:50.776Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1fbb3c3b-15b2-4a7d-9a79-cb3fbc879c16 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:25:50.775Z ElapsedTime=0 EndTimestamp=2021-07-13T00:25:50.775Z InvocationID=dcf94f49-759c-4a9c-8f63-986b79085412 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:25:50.957Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1fbb3c3b-15b2-4a7d-9a79-cb3fbc879c16 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:51.358Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1fbb3c3b-15b2-4a7d-9a79-cb3fbc879c16 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=583 EndTimestamp=2021-07-13T00:25:51.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:50.775Z InvocationID=1de9425f-8928-468f-9efa-d911f6dad994 ResponseDesc=OK 2021-07-13T00:25:54.063Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=11cd7e09-7348-4444-b2c7-7195a5431759 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:54.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:54.062Z InvocationID=16c25252-6982-4d9f-bcea-01bd846184dc 2021-07-13T00:25:54.116Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=11cd7e09-7348-4444-b2c7-7195a5431759 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:54.260Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=11cd7e09-7348-4444-b2c7-7195a5431759 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=198 EndTimestamp=2021-07-13T00:25:54.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:54.062Z InvocationID=6b7fb1fd-65d5-4411-87e3-add3791ea43b ResponseDesc=OK 2021-07-13T00:25:56.664Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aeea6708-9dd3-4fc8-a9b6-121817a5ce6c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:56.664Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:56.664Z InvocationID=4ab5a4e1-2187-41d0-a513-a98125b777fd 2021-07-13T00:25:57.011Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aeea6708-9dd3-4fc8-a9b6-121817a5ce6c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:57.260Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aeea6708-9dd3-4fc8-a9b6-121817a5ce6c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=596 EndTimestamp=2021-07-13T00:25:57.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:56.664Z InvocationID=7dec3d00-5b67-4609-874e-da979d30970c ResponseDesc=OK 2021-07-13T00:25:57.440Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b6a657f7-fe83-409a-81e7-842a79e5780c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:57.440Z InvocationID=92004b5c-bb91-4f98-90e5-d5dc3e13ab2e 2021-07-13T00:25:57.556Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b6a657f7-fe83-409a-81e7-842a79e5780c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:57.961Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b6a657f7-fe83-409a-81e7-842a79e5780c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=521 EndTimestamp=2021-07-13T00:25:57.961Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:57.440Z InvocationID=e61031cb-2831-467d-a5b3-53884481c5bc ResponseDesc=OK 2021-07-13T00:25:58.873Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4ddc1206-06fc-46b5-b5f0-eea329b043f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:58.873Z InvocationID=0e1c9456-1ab0-4064-8cab-2fdfca6fccac 2021-07-13T00:25:58.959Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4ddc1206-06fc-46b5-b5f0-eea329b043f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:25:59.315Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4ddc1206-06fc-46b5-b5f0-eea329b043f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=442 EndTimestamp=2021-07-13T00:25:59.315Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:58.873Z InvocationID=5d830f9e-f228-4a49-9b85-18dc4f289e09 ResponseDesc=OK 2021-07-13T00:25:59.769Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=68da9425-d27a-4dbf-bae2-1767e5a28235 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:25:59.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:59.768Z InvocationID=7ea7ce48-0506-4a56-b71b-514500b15b72 2021-07-13T00:25:59.911Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=68da9425-d27a-4dbf-bae2-1767e5a28235 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:00.164Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=68da9425-d27a-4dbf-bae2-1767e5a28235 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=396 EndTimestamp=2021-07-13T00:26:00.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:25:59.768Z InvocationID=27fc6904-db27-4edb-a39d-5e874ce0023e ResponseDesc=OK 2021-07-13T00:26:02.772Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f15db582-bb23-4a15-8657-4a9ed6910f4c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:02.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:02.772Z InvocationID=2a41619a-5aa0-4abd-9e91-8c9dba24a530 2021-07-13T00:26:02.957Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f15db582-bb23-4a15-8657-4a9ed6910f4c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:03.561Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f15db582-bb23-4a15-8657-4a9ed6910f4c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=789 EndTimestamp=2021-07-13T00:26:03.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:02.772Z InvocationID=d6344f94-ec1c-4132-88c2-42ef69b1b510 ResponseDesc=OK 2021-07-13T00:26:05.978Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0554865f-9e2f-46c8-89fe-cca416f3126f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:05.978Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:05.978Z InvocationID=13068859-aefb-4d21-8adb-a7f10cc61e2f 2021-07-13T00:26:06.163Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0554865f-9e2f-46c8-89fe-cca416f3126f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:06.452Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0554865f-9e2f-46c8-89fe-cca416f3126f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=474 EndTimestamp=2021-07-13T00:26:06.452Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:05.978Z InvocationID=22a6fc53-1d15-456d-baf1-8084d620d516 ResponseDesc=OK 2021-07-13T00:26:07.442Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5214124-c7fa-4580-8792-b217f217e5ad InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:07.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:07.442Z InvocationID=12d8ead0-feb3-4a17-93e2-06f7b09f7d37 2021-07-13T00:26:07.617Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5214124-c7fa-4580-8792-b217f217e5ad InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:07.864Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f5214124-c7fa-4580-8792-b217f217e5ad InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=422 EndTimestamp=2021-07-13T00:26:07.864Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:07.442Z InvocationID=4e6f35a5-6ed6-4550-af61-e419614ac89a ResponseDesc=OK 2021-07-13T00:26:08.765Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c8223427-937e-40d7-ac1f-df14e75da6ef InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:08.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:08.765Z InvocationID=fadd7edd-d2ba-4975-b231-0ba8fcfa6d35 2021-07-13T00:26:08.861Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c8223427-937e-40d7-ac1f-df14e75da6ef InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:08.874Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=30889057-dbc1-4563-83ff-eb161ea33045 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:08.874Z InvocationID=b640a993-9c3c-4c06-8e4d-20068f584e87 2021-07-13T00:26:08.960Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=30889057-dbc1-4563-83ff-eb161ea33045 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:09.157Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=30889057-dbc1-4563-83ff-eb161ea33045 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=283 EndTimestamp=2021-07-13T00:26:09.157Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:08.874Z InvocationID=80a866d4-7075-44c4-a083-3db934dee564 ResponseDesc=OK 2021-07-13T00:26:09.318Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c8223427-937e-40d7-ac1f-df14e75da6ef InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=553 EndTimestamp=2021-07-13T00:26:09.318Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:08.765Z InvocationID=a6bb1abc-a2cb-41de-ae4b-99b0d033d60c ResponseDesc=OK 2021-07-13T00:26:11.964Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a21f59c2-55da-4c80-8d24-4f47e4cc280b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:11.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:11.963Z InvocationID=1b5fd93e-6a04-4c87-8c5c-515bf0c5f8d0 2021-07-13T00:26:12.460Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a21f59c2-55da-4c80-8d24-4f47e4cc280b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:12.760Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a21f59c2-55da-4c80-8d24-4f47e4cc280b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=797 EndTimestamp=2021-07-13T00:26:12.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:11.963Z InvocationID=04c5297f-b560-47fa-84d4-134147ea3163 ResponseDesc=OK 2021-07-13T00:26:14.472Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=137a3d8a-ba9b-4fb8-b096-d53957e9d04f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:14.472Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:14.472Z InvocationID=1a0a6de7-3b9a-4fc8-8468-5a3092dd6be9 2021-07-13T00:26:14.656Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=137a3d8a-ba9b-4fb8-b096-d53957e9d04f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:15.058Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=137a3d8a-ba9b-4fb8-b096-d53957e9d04f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=586 EndTimestamp=2021-07-13T00:26:15.058Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:14.472Z InvocationID=0c5b4cb1-e748-4a07-86a4-8a242a2965fd ResponseDesc=OK 2021-07-13T00:26:17.439Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b7dfd032-31fd-4927-9cf9-7c9b71ac1cc5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:17.439Z InvocationID=2c79a0fb-3695-4078-9795-3fcf8fb19966 2021-07-13T00:26:17.563Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b7dfd032-31fd-4927-9cf9-7c9b71ac1cc5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:17.868Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b7dfd032-31fd-4927-9cf9-7c9b71ac1cc5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=429 EndTimestamp=2021-07-13T00:26:17.868Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:17.439Z InvocationID=5cef232a-2d9e-4d27-8993-b4e62bdb7970 ResponseDesc=OK 2021-07-13T00:26:18.163Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8d2795c3-60fb-412d-9469-a816bd6f8385 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:18.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:18.163Z InvocationID=f35be66b-3514-4889-9ba7-9cee22c0c593 2021-07-13T00:26:18.410Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8d2795c3-60fb-412d-9469-a816bd6f8385 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:18.660Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8d2795c3-60fb-412d-9469-a816bd6f8385 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=497 EndTimestamp=2021-07-13T00:26:18.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:18.163Z InvocationID=15f7f41d-4cc6-494b-ae5e-7ff3f130d223 ResponseDesc=OK 2021-07-13T00:26:18.874Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=734a0bb1-2fa7-4d42-b650-6637d9b702b5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:18.874Z InvocationID=2ec4e966-de02-45bb-82d8-543e211514af 2021-07-13T00:26:19.057Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=734a0bb1-2fa7-4d42-b650-6637d9b702b5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:19.459Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=734a0bb1-2fa7-4d42-b650-6637d9b702b5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=585 EndTimestamp=2021-07-13T00:26:19.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:18.874Z InvocationID=e9e3aadf-1399-4c2c-b982-01831a77a79a ResponseDesc=OK 2021-07-13T00:26:20.871Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bd5f001e-1d9f-42a2-b456-de5b5a5a9583 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:20.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:20.871Z InvocationID=c2669258-46e6-4d36-a776-49691843ca9e 2021-07-13T00:26:21.059Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bd5f001e-1d9f-42a2-b456-de5b5a5a9583 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:21.313Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bd5f001e-1d9f-42a2-b456-de5b5a5a9583 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=442 EndTimestamp=2021-07-13T00:26:21.313Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:20.871Z InvocationID=5ca4bfcc-a5a6-4c9e-9d39-9668024017fe ResponseDesc=OK 2021-07-13T00:26:23.664Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=013d16e1-ed55-4a5e-a295-4f7fb9e5b46d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:23.664Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:23.664Z InvocationID=9538110d-4ac5-4db8-991a-d75bcaed8e41 2021-07-13T00:26:23.811Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=013d16e1-ed55-4a5e-a295-4f7fb9e5b46d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:24.161Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=013d16e1-ed55-4a5e-a295-4f7fb9e5b46d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:26:24.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:23.664Z InvocationID=e7d69c26-6abe-4d11-aec9-4ec3abe03851 ResponseDesc=OK 2021-07-13T00:26:26.865Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0a8c1673-1ae2-4565-a651-964f0dd82928 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:26.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:26.865Z InvocationID=24895a9b-e4f2-425f-b26a-acc265b1426e 2021-07-13T00:26:26.957Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0a8c1673-1ae2-4565-a651-964f0dd82928 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:27.258Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0a8c1673-1ae2-4565-a651-964f0dd82928 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=393 EndTimestamp=2021-07-13T00:26:27.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:26.865Z InvocationID=596e6277-45d9-4433-8307-84a6159b90a7 ResponseDesc=OK 2021-07-13T00:26:27.441Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e62134d1-a592-4427-974d-d0a03941d33d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:27.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:27.441Z InvocationID=ec3c2c8c-0949-47bd-8286-2fcc677585f5 2021-07-13T00:26:27.558Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e62134d1-a592-4427-974d-d0a03941d33d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:28.876Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8af8b6dd-14b8-459b-a800-28f6e1160f11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:28.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:28.876Z InvocationID=95699428-6298-4a5c-bae7-28c5e4e84fdb 2021-07-13T00:26:29.964Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=574bb4ee-8bea-4191-95cc-2bc2c9abe795 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:29.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:29.964Z InvocationID=ff12c423-e9c9-461a-a166-61102fe6fa59 2021-07-13T00:26:30.463Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=574bb4ee-8bea-4191-95cc-2bc2c9abe795 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:30.518Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e62134d1-a592-4427-974d-d0a03941d33d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3077 EndTimestamp=2021-07-13T00:26:30.518Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:27.441Z InvocationID=2182268d-ebfe-4fa0-b095-b91d79662306 ResponseDesc=OK 2021-07-13T00:26:30.554Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8af8b6dd-14b8-459b-a800-28f6e1160f11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:30.660Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=574bb4ee-8bea-4191-95cc-2bc2c9abe795 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=696 EndTimestamp=2021-07-13T00:26:30.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:29.964Z InvocationID=0cd39119-ad4f-4939-8965-17443f02bda0 ResponseDesc=OK 2021-07-13T00:26:30.858Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8af8b6dd-14b8-459b-a800-28f6e1160f11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1982 EndTimestamp=2021-07-13T00:26:30.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:28.876Z InvocationID=3ea2581d-2efd-4806-a65e-2138dd35e806 ResponseDesc=OK 2021-07-13T00:26:32.780Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fa0620b9-06b4-4c00-b2ec-774712399d1a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:32.780Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:32.780Z InvocationID=376fcc27-0e29-4e64-8ad1-f4606989c37e 2021-07-13T00:26:32.860Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fa0620b9-06b4-4c00-b2ec-774712399d1a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:33.212Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fa0620b9-06b4-4c00-b2ec-774712399d1a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=432 EndTimestamp=2021-07-13T00:26:33.212Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:32.780Z InvocationID=875ea89b-681b-43c0-b7ea-463b100f8556 ResponseDesc=OK 2021-07-13T00:26:35.568Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dbe1254b-74fd-45d0-b449-30526dd50bd8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:35.568Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:35.568Z InvocationID=104b3da7-03fb-483d-ae62-8f1b091fa5da 2021-07-13T00:26:35.838Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dbe1254b-74fd-45d0-b449-30526dd50bd8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:36.059Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dbe1254b-74fd-45d0-b449-30526dd50bd8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=491 EndTimestamp=2021-07-13T00:26:36.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:35.568Z InvocationID=772e9187-3eda-46c0-a298-e73b9b44da9b ResponseDesc=OK 2021-07-13T00:26:37.444Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ef83460d-c35b-43d0-842c-015654d3b9a8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:37.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:37.443Z InvocationID=3710a42e-0ade-4fe7-97b8-72ba54c0f059 2021-07-13T00:26:37.467Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ef83460d-c35b-43d0-842c-015654d3b9a8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:37.757Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ef83460d-c35b-43d0-842c-015654d3b9a8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=314 EndTimestamp=2021-07-13T00:26:37.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:37.443Z InvocationID=34993635-04e6-4760-b61a-597ba582c865 ResponseDesc=OK 2021-07-13T00:26:38.865Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=35f7ff8c-ea65-403d-a00c-75caaf7ad55c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:38.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:38.865Z InvocationID=cc0a49a5-25de-4b02-830c-f79c0dffa7b5 2021-07-13T00:26:38.873Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3ebdd28d-144e-481d-81eb-554c9c499558 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:38.873Z InvocationID=2c9f0052-a104-4fe2-a839-a3a923fb2292 2021-07-13T00:26:38.960Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=35f7ff8c-ea65-403d-a00c-75caaf7ad55c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:39.057Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3ebdd28d-144e-481d-81eb-554c9c499558 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:39.363Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=35f7ff8c-ea65-403d-a00c-75caaf7ad55c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=498 EndTimestamp=2021-07-13T00:26:39.363Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:38.865Z InvocationID=ca40283a-9570-4340-9a65-0f50aea9b672 ResponseDesc=OK 2021-07-13T00:26:39.416Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3ebdd28d-144e-481d-81eb-554c9c499558 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=543 EndTimestamp=2021-07-13T00:26:39.416Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:38.873Z InvocationID=a8705959-5fd4-43a6-8a05-c98fd22c7a52 ResponseDesc=OK 2021-07-13T00:26:41.863Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ff8551a1-a6d3-4c31-8b8c-b5abe6a8509f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:41.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:41.863Z InvocationID=7de37711-ef0f-46b4-a6ce-fc25fd143f56 2021-07-13T00:26:42.057Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ff8551a1-a6d3-4c31-8b8c-b5abe6a8509f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:43.165Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ff8551a1-a6d3-4c31-8b8c-b5abe6a8509f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1302 EndTimestamp=2021-07-13T00:26:43.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:41.863Z InvocationID=936bbd41-6b4d-47f3-ad69-337697069676 ResponseDesc=OK 2021-07-13T00:26:44.961Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ee6be288-afa1-44e7-967c-a39186610caf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:44.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:44.961Z InvocationID=2fc5206d-26da-46c6-869c-54c8c98075a7 2021-07-13T00:26:45.251Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ee6be288-afa1-44e7-967c-a39186610caf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:46.016Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ee6be288-afa1-44e7-967c-a39186610caf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1055 EndTimestamp=2021-07-13T00:26:46.016Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:44.961Z InvocationID=9384c856-4e0a-49d4-8bb6-adb365fcda58 ResponseDesc=OK 2021-07-13T00:26:47.440Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=817c4d04-7d1b-4722-bb77-7a64350806d9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:47.440Z InvocationID=ce7d39b4-8221-442f-9471-c50af28014af 2021-07-13T00:26:47.571Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=817c4d04-7d1b-4722-bb77-7a64350806d9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:47.764Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=817c4d04-7d1b-4722-bb77-7a64350806d9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=324 EndTimestamp=2021-07-13T00:26:47.764Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:47.440Z InvocationID=b5a3751f-b708-4866-90b8-daa4e1563ed6 ResponseDesc=OK 2021-07-13T00:26:48.063Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3eb070da-ef3a-4f29-a701-b6da02762267 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:48.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:48.063Z InvocationID=d4ee7413-f174-41d1-bdfd-1f2d980ce75b 2021-07-13T00:26:48.457Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3eb070da-ef3a-4f29-a701-b6da02762267 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:48.873Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=289143ff-6137-4767-a2dc-eef824d837cf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:48.873Z InvocationID=53acbf01-1615-4e8b-8595-207f25f58194 2021-07-13T00:26:48.965Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=289143ff-6137-4767-a2dc-eef824d837cf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:49.066Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3eb070da-ef3a-4f29-a701-b6da02762267 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1002 EndTimestamp=2021-07-13T00:26:49.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:48.063Z InvocationID=11a1560d-ca94-440e-87c0-136473f09276 ResponseDesc=OK 2021-07-13T00:26:49.174Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=289143ff-6137-4767-a2dc-eef824d837cf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=300 EndTimestamp=2021-07-13T00:26:49.173Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:48.873Z InvocationID=3c61be59-4e67-4a56-ab99-424d70ca1e6c ResponseDesc=OK 2021-07-13T00:26:50.962Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f3d94caa-83b8-4eb0-99a0-59d7fe017979 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:50.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:50.962Z InvocationID=90ba2407-de45-46bc-9b1b-6d96c945de13 2021-07-13T00:26:51.207Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f3d94caa-83b8-4eb0-99a0-59d7fe017979 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:51.271Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f3d94caa-83b8-4eb0-99a0-59d7fe017979 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=309 EndTimestamp=2021-07-13T00:26:51.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:50.962Z InvocationID=13a0af8f-dda1-4c49-80b0-4c777034b032 ResponseDesc=OK 2021-07-13T00:26:53.961Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=34392061-3574-46ba-a5a1-c56aaa09664b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:53.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:53.961Z InvocationID=9d1aab51-db72-4091-80fa-baacd5e1d2ea 2021-07-13T00:26:54.156Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=34392061-3574-46ba-a5a1-c56aaa09664b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:54.458Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=34392061-3574-46ba-a5a1-c56aaa09664b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:26:54.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:53.961Z InvocationID=e617e4e3-dd9e-4b07-92e0-29e8d6a9f0c7 ResponseDesc=OK 2021-07-13T00:26:56.787Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4e4c2f54-b947-4a66-af8d-c04e73e38411 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:56.786Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:56.786Z InvocationID=a085bb7d-696d-41e1-be1f-947686bc0405 2021-07-13T00:26:56.863Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4e4c2f54-b947-4a66-af8d-c04e73e38411 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:57.215Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4e4c2f54-b947-4a66-af8d-c04e73e38411 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=429 EndTimestamp=2021-07-13T00:26:57.215Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:56.786Z InvocationID=72153d10-fd09-4f67-a855-0fcc855ff209 ResponseDesc=OK 2021-07-13T00:26:57.446Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1609afcd-661f-4269-9e50-ac1ccc713cb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:57.446Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:57.446Z InvocationID=4d334a87-2a90-4abb-a2ca-ba2c71e34a1c 2021-07-13T00:26:57.615Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1609afcd-661f-4269-9e50-ac1ccc713cb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:57.860Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1609afcd-661f-4269-9e50-ac1ccc713cb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=413 EndTimestamp=2021-07-13T00:26:57.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:57.446Z InvocationID=153860ec-6c71-4ce3-ba26-f17660ae530e ResponseDesc=OK 2021-07-13T00:26:58.874Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4ab83af9-5f5f-4868-8723-051987859c85 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:58.874Z InvocationID=b253cb7d-e94d-4fc4-a9a3-772b7f1f65ca 2021-07-13T00:26:59.057Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4ab83af9-5f5f-4868-8723-051987859c85 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:26:59.457Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4ab83af9-5f5f-4868-8723-051987859c85 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=583 EndTimestamp=2021-07-13T00:26:59.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:58.874Z InvocationID=5ee84f1f-e4f4-4fe9-9bfe-77d8280404df ResponseDesc=OK 2021-07-13T00:26:59.763Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6efa2ed4-2f5f-438b-abd9-0c076440c469 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:26:59.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:59.763Z InvocationID=e5dfd245-42cd-4598-b9bd-1221c4ac7dd6 2021-07-13T00:26:59.860Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6efa2ed4-2f5f-438b-abd9-0c076440c469 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:00.321Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6efa2ed4-2f5f-438b-abd9-0c076440c469 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=558 EndTimestamp=2021-07-13T00:27:00.321Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:26:59.763Z InvocationID=6f540c42-74c1-4fb5-83e9-58c0802674e2 ResponseDesc=OK 2021-07-13T00:27:02.861Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c46f4a5e-0e88-4ebd-b4eb-16a5f16129f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:02.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:02.861Z InvocationID=0a5325cb-6b04-44e8-baf3-f02d523511ac 2021-07-13T00:27:03.115Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c46f4a5e-0e88-4ebd-b4eb-16a5f16129f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:03.359Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c46f4a5e-0e88-4ebd-b4eb-16a5f16129f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=498 EndTimestamp=2021-07-13T00:27:03.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:02.861Z InvocationID=890a3324-8489-4bc0-9d9c-281f6601ab88 ResponseDesc=OK 2021-07-13T00:27:05.961Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3fc39ae8-5767-4591-a531-1c5bf009c80a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:05.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:05.961Z InvocationID=f2283db0-483d-418c-8744-0655ceb18686 2021-07-13T00:27:06.056Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3fc39ae8-5767-4591-a531-1c5bf009c80a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:06.357Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3fc39ae8-5767-4591-a531-1c5bf009c80a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=396 EndTimestamp=2021-07-13T00:27:06.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:05.961Z InvocationID=3e6108c3-d1bc-4626-aa92-ee5caea6ae62 ResponseDesc=OK 2021-07-13T00:27:07.440Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=09d6903a-4f91-4ede-9676-cb3830054ece InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:07.440Z InvocationID=17379b21-8507-4899-9b6f-6df28dfa1fa7 2021-07-13T00:27:07.959Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=09d6903a-4f91-4ede-9676-cb3830054ece InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:08.314Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=09d6903a-4f91-4ede-9676-cb3830054ece InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=874 EndTimestamp=2021-07-13T00:27:08.314Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:07.440Z InvocationID=412e598d-73a0-4bb6-a709-007f41981a96 ResponseDesc=OK 2021-07-13T00:27:08.581Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=14e4975f-e12d-4fb4-a158-011d9f701719 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:08.581Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:08.581Z InvocationID=c3bf0437-3a6c-442d-8be5-b48e9219d408 2021-07-13T00:27:08.811Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=14e4975f-e12d-4fb4-a158-011d9f701719 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:08.873Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b58feee5-4a80-4461-a1c6-feac256d12bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:08.873Z InvocationID=ce9ed923-f5fb-48be-a1af-cbdd50f899ec 2021-07-13T00:27:09.057Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b58feee5-4a80-4461-a1c6-feac256d12bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:09.060Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=14e4975f-e12d-4fb4-a158-011d9f701719 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=478 EndTimestamp=2021-07-13T00:27:09.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:08.581Z InvocationID=e9fb27fb-285c-413f-83e1-7b257bb4f2ab ResponseDesc=OK 2021-07-13T00:27:09.457Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b58feee5-4a80-4461-a1c6-feac256d12bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=584 EndTimestamp=2021-07-13T00:27:09.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:08.873Z InvocationID=aaf9d615-b785-4363-919a-7b4a5d86e85c ResponseDesc=OK 2021-07-13T00:27:11.671Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=71429ca5-caf4-44a5-b55a-04af73d2ffce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:11.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:11.671Z InvocationID=159be8c2-7da2-4656-a869-91e7093d6eee 2021-07-13T00:27:11.760Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=71429ca5-caf4-44a5-b55a-04af73d2ffce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:12.212Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=71429ca5-caf4-44a5-b55a-04af73d2ffce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=541 EndTimestamp=2021-07-13T00:27:12.212Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:11.671Z InvocationID=cc8ac4a5-5317-4018-84b9-2135d757abd2 ResponseDesc=OK 2021-07-13T00:27:14.662Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c2bbb23b-7491-4843-bfb4-1fb5b099cb5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:14.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:14.662Z InvocationID=9f77ea28-6772-4300-b5de-97ca51675d15 2021-07-13T00:27:14.822Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c2bbb23b-7491-4843-bfb4-1fb5b099cb5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:15.165Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c2bbb23b-7491-4843-bfb4-1fb5b099cb5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=502 EndTimestamp=2021-07-13T00:27:15.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:14.662Z InvocationID=85c923cf-151c-4a8d-bd32-892b51d2b2ff ResponseDesc=OK 2021-07-13T00:27:17.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=af0073c2-4569-44f5-b583-4f7e1e378512 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:17.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:17.440Z InvocationID=aecab41f-04b9-4990-ba90-e3fca0e192e1 2021-07-13T00:27:17.556Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=af0073c2-4569-44f5-b583-4f7e1e378512 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:17.857Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=af0073c2-4569-44f5-b583-4f7e1e378512 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=417 EndTimestamp=2021-07-13T00:27:17.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:17.440Z InvocationID=a82df2bf-f2a2-4d57-bc9c-7c5c23d1641b ResponseDesc=OK 2021-07-13T00:27:17.960Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b4957e97-d123-46da-a978-003607ac59a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:17.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:17.960Z InvocationID=3a488d23-75ea-4961-85c9-c18b35103531 2021-07-13T00:27:18.059Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b4957e97-d123-46da-a978-003607ac59a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:18.414Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b4957e97-d123-46da-a978-003607ac59a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=454 EndTimestamp=2021-07-13T00:27:18.414Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:17.960Z InvocationID=bd160432-283d-4541-8db0-c171a6a5b3e4 ResponseDesc=OK 2021-07-13T00:27:18.874Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a71289b3-f317-4e5d-860e-97292786cba5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:18.874Z InvocationID=8850f8e6-d6ad-4240-85a9-474bffe7b2d7 2021-07-13T00:27:19.110Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a71289b3-f317-4e5d-860e-97292786cba5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:19.361Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a71289b3-f317-4e5d-860e-97292786cba5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:27:19.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:18.874Z InvocationID=fcd13fc7-3b05-4530-bc1b-78a9afd80847 ResponseDesc=OK 2021-07-13T00:27:20.964Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=677e33f3-d245-4923-af7f-ce49f3a651c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:20.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:20.964Z InvocationID=4187ab80-8ced-4702-8081-1b3aca073529 2021-07-13T00:27:21.057Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=677e33f3-d245-4923-af7f-ce49f3a651c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:21.357Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=677e33f3-d245-4923-af7f-ce49f3a651c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=393 EndTimestamp=2021-07-13T00:27:21.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:20.964Z InvocationID=2999600a-54aa-4363-b2d7-9f7dcd26b307 ResponseDesc=OK 2021-07-13T00:27:24.063Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e7ec2f1-7c38-4210-be03-d0e07da45960 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:24.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:24.063Z InvocationID=cdfd672d-31bc-4eff-a341-10b6c766b82e 2021-07-13T00:27:24.113Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e7ec2f1-7c38-4210-be03-d0e07da45960 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:25.314Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e7ec2f1-7c38-4210-be03-d0e07da45960 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1251 EndTimestamp=2021-07-13T00:27:25.314Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:24.063Z InvocationID=46e38622-1c16-4b58-8e3a-fa48672e7deb ResponseDesc=OK 2021-07-13T00:27:26.563Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9eaac4b2-6402-4533-8f88-7632b723c386 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:26.563Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:26.563Z InvocationID=b9149845-3042-4d03-a28e-1e82b4d5e24f 2021-07-13T00:27:26.727Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9eaac4b2-6402-4533-8f88-7632b723c386 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:26.960Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9eaac4b2-6402-4533-8f88-7632b723c386 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=397 EndTimestamp=2021-07-13T00:27:26.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:26.563Z InvocationID=571a7031-7657-4a11-b08f-da05bcb5e682 ResponseDesc=OK 2021-07-13T00:27:27.440Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=33e663ad-fb22-484a-88ac-23f29b9fb6f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:27.440Z InvocationID=7be2762b-b90c-4955-bc61-a08b52a7a722 2021-07-13T00:27:27.556Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=33e663ad-fb22-484a-88ac-23f29b9fb6f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:28.159Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=33e663ad-fb22-484a-88ac-23f29b9fb6f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=719 EndTimestamp=2021-07-13T00:27:28.159Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:27.440Z InvocationID=cfc76aa0-1c63-4e3c-ad2a-bd688419e8ce ResponseDesc=OK 2021-07-13T00:27:28.876Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=276fb9a2-cb2a-4c96-83bf-d19ecd060137 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:28.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:28.876Z InvocationID=4b1b6d69-4790-48f6-a9b8-922b5a2a7cc1 2021-07-13T00:27:29.059Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=276fb9a2-cb2a-4c96-83bf-d19ecd060137 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:29.367Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=276fb9a2-cb2a-4c96-83bf-d19ecd060137 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=491 EndTimestamp=2021-07-13T00:27:29.367Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:28.876Z InvocationID=fa59c4f9-4f46-48a5-bf6a-056ae220c86c ResponseDesc=OK 2021-07-13T00:27:29.867Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9c45d142-af23-4348-af2a-6d9d29c7fd37 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:29.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:29.866Z InvocationID=4e13da22-76ab-42d5-bb49-0f98e110fed7 2021-07-13T00:27:30.672Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9c45d142-af23-4348-af2a-6d9d29c7fd37 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:30.773Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9c45d142-af23-4348-af2a-6d9d29c7fd37 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=906 EndTimestamp=2021-07-13T00:27:30.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:29.866Z InvocationID=4c98045b-0b0b-47a0-a0b9-d40e80d92a49 ResponseDesc=OK 2021-07-13T00:27:32.469Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=66b04954-d5e9-4443-bedb-9ed773e16e36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:32.468Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:32.468Z InvocationID=d72f7295-932e-46e4-be62-bb980f783edd 2021-07-13T00:27:32.656Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=66b04954-d5e9-4443-bedb-9ed773e16e36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:32.957Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=66b04954-d5e9-4443-bedb-9ed773e16e36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=489 EndTimestamp=2021-07-13T00:27:32.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:32.468Z InvocationID=a18c2ba3-2adf-4dce-88b9-dc315f9295e8 ResponseDesc=OK 2021-07-13T00:27:35.971Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dc8a16e3-0022-4405-ae3d-d519ce7c2a70 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:35.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:35.971Z InvocationID=dfb29e80-2192-4843-8a39-5c7984ffa962 2021-07-13T00:27:36.059Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dc8a16e3-0022-4405-ae3d-d519ce7c2a70 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:36.428Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dc8a16e3-0022-4405-ae3d-d519ce7c2a70 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=457 EndTimestamp=2021-07-13T00:27:36.428Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:35.971Z InvocationID=6e43176e-2733-47a4-92ed-6669c9e4f54e ResponseDesc=OK 2021-07-13T00:27:37.440Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ebb3ef79-8461-4b8a-9835-d3e549f248ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:37.440Z InvocationID=ac37d3ca-8f64-4534-87df-9f51b3a1f50c 2021-07-13T00:27:37.613Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ebb3ef79-8461-4b8a-9835-d3e549f248ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:37.860Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ebb3ef79-8461-4b8a-9835-d3e549f248ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=420 EndTimestamp=2021-07-13T00:27:37.860Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:37.440Z InvocationID=4ce3a504-4c38-4125-8c8b-91d9a678d62e ResponseDesc=OK 2021-07-13T00:27:38.665Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=078c6e1f-1adc-4a7f-b983-16fad7ebf34b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:38.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:38.665Z InvocationID=73f70795-ba0b-4993-b554-cfa06e604699 2021-07-13T00:27:38.759Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=078c6e1f-1adc-4a7f-b983-16fad7ebf34b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:38.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=08d045f1-3f31-456e-87b8-7af8b0be5dea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:38.873Z InvocationID=b97d2400-2706-4344-b2f1-b487812a59e1 2021-07-13T00:27:38.959Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=08d045f1-3f31-456e-87b8-7af8b0be5dea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:39.258Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=078c6e1f-1adc-4a7f-b983-16fad7ebf34b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=593 EndTimestamp=2021-07-13T00:27:39.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:38.665Z InvocationID=a3a1ae25-0eb4-499b-8874-29e81ff0e56e ResponseDesc=OK 2021-07-13T00:27:39.319Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=08d045f1-3f31-456e-87b8-7af8b0be5dea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=446 EndTimestamp=2021-07-13T00:27:39.319Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:38.873Z InvocationID=4bd58fe8-a2ec-4df9-ae14-d3c2bda80532 ResponseDesc=OK 2021-07-13T00:27:41.773Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9a80b79a-be8d-4f37-b446-28fe50c9fe11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:41.773Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:41.773Z InvocationID=0255f2ea-415b-4ae1-bb04-61e7e14c8ead 2021-07-13T00:27:42.116Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9a80b79a-be8d-4f37-b446-28fe50c9fe11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:42.865Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9a80b79a-be8d-4f37-b446-28fe50c9fe11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1091 EndTimestamp=2021-07-13T00:27:42.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:41.773Z InvocationID=8f1ec56f-e0f9-47c9-969b-f84dbefcfafb ResponseDesc=OK 2021-07-13T00:27:45.073Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e7d79beb-426a-4d4e-ad07-b33e7c20d833 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:45.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:45.072Z InvocationID=dd8a479e-cc1f-4d05-8c7b-538b8de35189 2021-07-13T00:27:45.257Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e7d79beb-426a-4d4e-ad07-b33e7c20d833 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:45.558Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e7d79beb-426a-4d4e-ad07-b33e7c20d833 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:27:45.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:45.072Z InvocationID=64e12930-9b16-4461-8fc3-0f5634cf394a ResponseDesc=OK 2021-07-13T00:27:47.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bc0619b2-64e1-4336-be5e-96f2faba63d1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:47.440Z InvocationID=1228fc8c-7301-4f28-9bae-ee152b80e8a2 2021-07-13T00:27:47.624Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bc0619b2-64e1-4336-be5e-96f2faba63d1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:48.071Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=71823e8e-30b7-43f0-be43-79c48ae6a9c4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:48.070Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:48.070Z InvocationID=dd76d441-2b6d-469d-8a51-404b8e65183b 2021-07-13T00:27:48.319Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=71823e8e-30b7-43f0-be43-79c48ae6a9c4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:48.320Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bc0619b2-64e1-4336-be5e-96f2faba63d1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=880 EndTimestamp=2021-07-13T00:27:48.320Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:47.440Z InvocationID=d009902c-c689-4cd1-8a3f-ada886b93997 ResponseDesc=OK 2021-07-13T00:27:48.874Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c15f44b4-12b4-4433-82b1-bc30165ca57f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:48.874Z InvocationID=cdff3add-81cd-44cc-8054-082362719471 2021-07-13T00:27:49.056Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c15f44b4-12b4-4433-82b1-bc30165ca57f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:49.160Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=71823e8e-30b7-43f0-be43-79c48ae6a9c4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1089 EndTimestamp=2021-07-13T00:27:49.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:48.070Z InvocationID=ac9b6bae-5346-40cb-b762-39855d020bf0 ResponseDesc=OK 2021-07-13T00:27:49.664Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c15f44b4-12b4-4433-82b1-bc30165ca57f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=790 EndTimestamp=2021-07-13T00:27:49.664Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:48.874Z InvocationID=8ef0d2ec-f9c5-42a8-ab0e-ee8f7e6e0ed1 ResponseDesc=OK 2021-07-13T00:27:50.476Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ba3d13ea-9cc5-4d2e-9ab8-d92770551365 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:50.476Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:50.476Z InvocationID=da10613d-5d8d-474f-af12-6c508fd3f979 2021-07-13T00:27:53.011Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ba3d13ea-9cc5-4d2e-9ab8-d92770551365 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:54.214Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ba3d13ea-9cc5-4d2e-9ab8-d92770551365 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3738 EndTimestamp=2021-07-13T00:27:54.214Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:50.476Z InvocationID=e5e2e257-757d-4994-b090-11d3cb3403bd ResponseDesc=OK 2021-07-13T00:27:54.626Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=327966cb-b59c-4b84-a9aa-dbd521b10f29 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:54.626Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:54.626Z InvocationID=6243a051-2076-4603-839f-2c3ffbf6862e 2021-07-13T00:27:54.912Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=327966cb-b59c-4b84-a9aa-dbd521b10f29 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:55.161Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=327966cb-b59c-4b84-a9aa-dbd521b10f29 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=535 EndTimestamp=2021-07-13T00:27:55.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:54.626Z InvocationID=605652b0-5754-47a9-bb21-f8c1d2579a96 ResponseDesc=OK 2021-07-13T00:27:56.567Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=94081c70-2393-4094-803e-9636202b3aab InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:56.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:56.567Z InvocationID=f6849d15-109e-4b43-947a-9b35424c8b3b 2021-07-13T00:27:56.964Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=94081c70-2393-4094-803e-9636202b3aab InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:57.384Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=94081c70-2393-4094-803e-9636202b3aab InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=817 EndTimestamp=2021-07-13T00:27:57.384Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:56.567Z InvocationID=f94bc5a1-30c6-43d0-9f5e-1116b88be999 ResponseDesc=OK 2021-07-13T00:27:57.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3435a046-f16e-48e3-940a-5e4d7da0d432 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:57.440Z InvocationID=e84f8ba7-afb8-4684-b89a-6b5d1323da99 2021-07-13T00:27:57.559Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3435a046-f16e-48e3-940a-5e4d7da0d432 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:57.819Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3435a046-f16e-48e3-940a-5e4d7da0d432 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=379 EndTimestamp=2021-07-13T00:27:57.819Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:57.440Z InvocationID=1b259f12-2ba8-4a51-8f60-d2abaecc71e7 ResponseDesc=OK 2021-07-13T00:27:58.873Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6f9613c0-9260-46ab-bcb1-9e9b3e563d0e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:58.873Z InvocationID=9705175c-d086-4d11-b42f-c808d20a9f17 2021-07-13T00:27:59.112Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6f9613c0-9260-46ab-bcb1-9e9b3e563d0e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:27:59.359Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6f9613c0-9260-46ab-bcb1-9e9b3e563d0e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:27:59.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:58.873Z InvocationID=45497dd9-d8fc-482e-8067-a92fe399a2f5 ResponseDesc=OK 2021-07-13T00:27:59.964Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b2fa1012-ee9b-4747-9e9c-5a89bd3b74fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:27:59.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:59.964Z InvocationID=4e0233b6-0242-4f2a-8759-4a3e9904321c 2021-07-13T00:28:00.157Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b2fa1012-ee9b-4747-9e9c-5a89bd3b74fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:00.859Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b2fa1012-ee9b-4747-9e9c-5a89bd3b74fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=895 EndTimestamp=2021-07-13T00:28:00.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:27:59.964Z InvocationID=7ccaa7f8-dd23-47a0-a451-6673c9edb278 ResponseDesc=OK 2021-07-13T00:28:02.770Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=10dd59db-9ee5-4358-86e5-870909eb738f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:02.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:02.770Z InvocationID=917be905-7b2f-438e-a9f4-8c2ee9909d7f 2021-07-13T00:28:02.868Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=10dd59db-9ee5-4358-86e5-870909eb738f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:03.628Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=10dd59db-9ee5-4358-86e5-870909eb738f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=858 EndTimestamp=2021-07-13T00:28:03.628Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:02.770Z InvocationID=fa0cab74-f0d6-46d1-9d7c-38f835c7e996 ResponseDesc=OK 2021-07-13T00:28:05.872Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da2c49c7-b33f-4fe0-875d-8df10422bab2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:05.872Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:05.872Z InvocationID=6541d065-1dfc-4947-80e1-1f7fe8640dd6 2021-07-13T00:28:06.062Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da2c49c7-b33f-4fe0-875d-8df10422bab2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:06.164Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da2c49c7-b33f-4fe0-875d-8df10422bab2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=291 EndTimestamp=2021-07-13T00:28:06.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:05.872Z InvocationID=ac9fbe7f-ef51-4d40-9b36-1f249b3efdca ResponseDesc=OK 2021-07-13T00:28:07.441Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eafc2ed7-447c-4548-8c14-b2edfcdbd255 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:07.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:07.441Z InvocationID=14866700-48d9-4812-aecb-3031568b0468 2021-07-13T00:28:07.660Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eafc2ed7-447c-4548-8c14-b2edfcdbd255 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:07.866Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eafc2ed7-447c-4548-8c14-b2edfcdbd255 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=425 EndTimestamp=2021-07-13T00:28:07.866Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:07.441Z InvocationID=a211533d-116c-4377-8dd5-0d5a37283428 ResponseDesc=OK 2021-07-13T00:28:08.765Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9f76dbce-5c33-47b7-bad8-68bf04a553e2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:08.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:08.765Z InvocationID=9b1d71be-0a98-4eb3-b788-08a0e8f42d82 2021-07-13T00:28:08.867Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9f76dbce-5c33-47b7-bad8-68bf04a553e2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:08.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=db59ea03-236f-424d-921e-138166287d75 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:08.874Z InvocationID=6265c6d8-bae5-47fb-b1ae-57534f34bc85 2021-07-13T00:28:09.059Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=db59ea03-236f-424d-921e-138166287d75 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:09.068Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9f76dbce-5c33-47b7-bad8-68bf04a553e2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=303 EndTimestamp=2021-07-13T00:28:09.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:08.765Z InvocationID=6c5af53b-abd8-4a6f-8604-cc2437ed5724 ResponseDesc=OK 2021-07-13T00:28:09.160Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=db59ea03-236f-424d-921e-138166287d75 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=286 EndTimestamp=2021-07-13T00:28:09.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:08.874Z InvocationID=c88acfc7-5d8a-435c-8a11-16898db6e719 ResponseDesc=OK 2021-07-13T00:28:11.973Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5d2b3953-7d56-4977-8e12-2e73818ad198 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:11.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:11.972Z InvocationID=8945c6df-00cd-4753-bf40-9958fb9aa3b3 2021-07-13T00:28:11.987Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5d2b3953-7d56-4977-8e12-2e73818ad198 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:12.076Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5d2b3953-7d56-4977-8e12-2e73818ad198 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=104 EndTimestamp=2021-07-13T00:28:12.076Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:11.972Z InvocationID=9c8d8d25-a106-48fb-9eeb-6b43c59a2f0c ResponseDesc=OK 2021-07-13T00:28:14.866Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=db99b6ad-369b-416c-a5e9-31550a90d72d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:14.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:14.866Z InvocationID=6219a219-ddc6-45ba-8f9c-b85728c7cbf5 2021-07-13T00:28:14.959Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=db99b6ad-369b-416c-a5e9-31550a90d72d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:16.125Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=db99b6ad-369b-416c-a5e9-31550a90d72d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1259 EndTimestamp=2021-07-13T00:28:16.125Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:14.866Z InvocationID=29b4f19b-0c1a-4b33-8b52-881e0bff8dd6 ResponseDesc=OK 2021-07-13T00:28:17.440Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f76fdd46-5b7b-463b-a094-5838246773ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:17.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:17.440Z InvocationID=dd70990c-7c20-4dcc-9b1b-89c370aaee38 2021-07-13T00:28:17.569Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a36a18ab-3246-4f08-afd1-dc3fcbfdac3a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:17.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:17.569Z InvocationID=7a35a5f4-58a1-49d3-a0ca-6164008f5301 2021-07-13T00:28:17.659Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a36a18ab-3246-4f08-afd1-dc3fcbfdac3a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:17.666Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f76fdd46-5b7b-463b-a094-5838246773ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:17.860Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f76fdd46-5b7b-463b-a094-5838246773ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=420 EndTimestamp=2021-07-13T00:28:17.860Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:17.440Z InvocationID=394e7233-c49f-44ba-89e8-731acb8e15b8 ResponseDesc=OK 2021-07-13T00:28:18.060Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a36a18ab-3246-4f08-afd1-dc3fcbfdac3a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=491 EndTimestamp=2021-07-13T00:28:18.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:17.569Z InvocationID=e57c7603-4db6-4f1b-9255-658d7cf903f5 ResponseDesc=OK 2021-07-13T00:28:18.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=55711901-54f8-4119-b893-bbc6e5e8e407 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:18.873Z InvocationID=7d9b5bcd-1109-419b-ba41-41c21473a1f8 2021-07-13T00:28:19.060Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=55711901-54f8-4119-b893-bbc6e5e8e407 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:19.221Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=55711901-54f8-4119-b893-bbc6e5e8e407 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=348 EndTimestamp=2021-07-13T00:28:19.221Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:18.873Z InvocationID=3d3fbf8c-49b9-4eb7-910b-8444f3d69519 ResponseDesc=OK 2021-07-13T00:28:21.072Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8984c91f-ba80-4f67-837f-3d3fe8514ed0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:21.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:21.072Z InvocationID=14e76e91-b76f-4303-9e6c-8aa76fade390 2021-07-13T00:28:21.166Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8984c91f-ba80-4f67-837f-3d3fe8514ed0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:21.277Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8984c91f-ba80-4f67-837f-3d3fe8514ed0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=205 EndTimestamp=2021-07-13T00:28:21.277Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:21.072Z InvocationID=09aaeb33-0d1a-40c5-b8aa-13a9c954cbc1 ResponseDesc=OK 2021-07-13T00:28:23.361Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1e38cd1d-3274-4600-9031-7f0397431373 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:23.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:23.361Z InvocationID=7a0b8a8d-78c2-4927-ab7d-153a3c0aa96e 2021-07-13T00:28:23.370Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1e38cd1d-3274-4600-9031-7f0397431373 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:23.477Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1e38cd1d-3274-4600-9031-7f0397431373 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=116 EndTimestamp=2021-07-13T00:28:23.477Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:23.361Z InvocationID=4f88c044-d6fc-4729-a878-ee7957e09d28 ResponseDesc=OK 2021-07-13T00:28:26.962Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5dc7421e-12a0-40df-a049-f42c8922142a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:26.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:26.962Z InvocationID=303817d4-9d3c-4964-9e63-9f48ba4a2154 2021-07-13T00:28:27.059Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5dc7421e-12a0-40df-a049-f42c8922142a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:27.271Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5dc7421e-12a0-40df-a049-f42c8922142a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=309 EndTimestamp=2021-07-13T00:28:27.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:26.962Z InvocationID=51a755d2-a1c9-4a31-be28-6c4a17943400 ResponseDesc=OK 2021-07-13T00:28:27.439Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5b6a8e2f-2646-4f7b-83e3-4b39ba91cfc4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:27.439Z InvocationID=63406aa0-9aeb-4763-a94e-f6d45b4fee9e 2021-07-13T00:28:27.563Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5b6a8e2f-2646-4f7b-83e3-4b39ba91cfc4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:27.863Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5b6a8e2f-2646-4f7b-83e3-4b39ba91cfc4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=424 EndTimestamp=2021-07-13T00:28:27.863Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:27.439Z InvocationID=1823e02d-afd4-4689-8fb5-5cf6d3bb33d3 ResponseDesc=OK 2021-07-13T00:28:28.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6e38aa23-e180-4e06-870b-5e1771dc5e8f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:28.874Z InvocationID=6a5385d8-7d97-4809-94e6-404c4e4af048 2021-07-13T00:28:29.057Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6e38aa23-e180-4e06-870b-5e1771dc5e8f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:29.366Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6e38aa23-e180-4e06-870b-5e1771dc5e8f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=492 EndTimestamp=2021-07-13T00:28:29.366Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:28.874Z InvocationID=ae3fe73f-4fbc-417b-aca4-2bdcaaae53c6 ResponseDesc=OK 2021-07-13T00:28:30.068Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7c5bfbfa-6707-4c8b-a720-3e9f2c4693e1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:30.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:30.068Z InvocationID=0ffb9e90-f973-4ee7-ae2c-7a2fb3450dfa 2021-07-13T00:28:30.160Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7c5bfbfa-6707-4c8b-a720-3e9f2c4693e1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:30.464Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7c5bfbfa-6707-4c8b-a720-3e9f2c4693e1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=396 EndTimestamp=2021-07-13T00:28:30.464Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:30.068Z InvocationID=590ee1be-44ab-42af-a43d-00c3d9bda7fd ResponseDesc=OK 2021-07-13T00:28:32.970Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=77e33122-d816-4272-82b2-0c9a52c0479e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:32.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:32.970Z InvocationID=987a28bd-f162-4b51-b149-6f98a06cf1f1 2021-07-13T00:28:33.367Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=77e33122-d816-4272-82b2-0c9a52c0479e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:34.118Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=77e33122-d816-4272-82b2-0c9a52c0479e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1148 EndTimestamp=2021-07-13T00:28:34.118Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:32.970Z InvocationID=d75557be-70d5-4328-88cb-005001c4d6f5 ResponseDesc=OK 2021-07-13T00:28:35.665Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c6815ae6-48a8-4522-b60d-9a555f30a345 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:35.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:35.665Z InvocationID=ca936081-354d-45d7-b938-afe3ca0175e4 2021-07-13T00:28:35.863Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c6815ae6-48a8-4522-b60d-9a555f30a345 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:36.163Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c6815ae6-48a8-4522-b60d-9a555f30a345 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=498 EndTimestamp=2021-07-13T00:28:36.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:35.665Z InvocationID=b0cf9a7e-9e5d-4064-9b80-4d51e0b4dbd1 ResponseDesc=OK 2021-07-13T00:28:37.439Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce3c53b8-81b4-42ce-9df1-1fe5131b480d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:37.439Z InvocationID=5e4108f5-da4b-4497-8ba8-7dc32d8fba2d 2021-07-13T00:28:37.471Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce3c53b8-81b4-42ce-9df1-1fe5131b480d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:38.016Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ce3c53b8-81b4-42ce-9df1-1fe5131b480d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=577 EndTimestamp=2021-07-13T00:28:38.016Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:37.439Z InvocationID=7fe0fab7-b798-4a56-8dec-261bd12738ed ResponseDesc=OK 2021-07-13T00:28:38.873Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7676c415-1399-4263-bd33-f1be4d2420b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:38.873Z InvocationID=bd718089-2bd0-4669-ae8f-ec30484dd269 2021-07-13T00:28:38.962Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=08e06387-a91b-4d57-bee1-125846dcfa81 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:38.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:38.962Z InvocationID=f06beceb-2aea-4b95-99fa-8443270f746d 2021-07-13T00:28:39.360Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=08e06387-a91b-4d57-bee1-125846dcfa81 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:39.413Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7676c415-1399-4263-bd33-f1be4d2420b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:39.567Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=08e06387-a91b-4d57-bee1-125846dcfa81 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=605 EndTimestamp=2021-07-13T00:28:39.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:38.962Z InvocationID=ef543018-ec58-41f2-bf0e-88e6a25bc28c ResponseDesc=OK 2021-07-13T00:28:39.657Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7676c415-1399-4263-bd33-f1be4d2420b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=784 EndTimestamp=2021-07-13T00:28:39.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:38.873Z InvocationID=c32bf5ff-d235-4f5f-b5bf-c20ca81cf095 ResponseDesc=OK 2021-07-13T00:28:41.859Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8ad107c3-56e2-4d6a-843d-41f7ee9e96c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:41.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:41.859Z InvocationID=25b52e8f-12f1-4df0-b164-f1fce99f2cf2 2021-07-13T00:28:41.959Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8ad107c3-56e2-4d6a-843d-41f7ee9e96c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:42.172Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8ad107c3-56e2-4d6a-843d-41f7ee9e96c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=313 EndTimestamp=2021-07-13T00:28:42.172Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:41.859Z InvocationID=55f14403-24f5-47e7-81aa-65453d04e1ab ResponseDesc=OK 2021-07-13T00:28:44.381Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bfd9bb48-6ce3-4fe6-8f0b-78873d4f9869 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:44.381Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:44.381Z InvocationID=84b15f19-094a-4298-8285-695baffbd457 2021-07-13T00:28:44.614Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bfd9bb48-6ce3-4fe6-8f0b-78873d4f9869 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:44.813Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bfd9bb48-6ce3-4fe6-8f0b-78873d4f9869 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=432 EndTimestamp=2021-07-13T00:28:44.813Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:44.381Z InvocationID=78cd0bd6-ea43-4ce0-9a5e-03fa67906d6f ResponseDesc=OK 2021-07-13T00:28:47.439Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1822c623-1587-45b8-ab43-4822a3e92b73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:47.439Z InvocationID=68a639bc-7c81-4666-b155-15e6d8b72b48 2021-07-13T00:28:47.556Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1822c623-1587-45b8-ab43-4822a3e92b73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:47.959Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1822c623-1587-45b8-ab43-4822a3e92b73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=520 EndTimestamp=2021-07-13T00:28:47.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:47.439Z InvocationID=cd09d94d-a17c-4e7d-8b4e-19cac5021fc8 ResponseDesc=OK 2021-07-13T00:28:48.065Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31c9030e-b59e-474f-9c9d-ae493832af75 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:48.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:48.065Z InvocationID=132015fc-1ff2-44c3-95d1-abbd3db27ba2 2021-07-13T00:28:48.168Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31c9030e-b59e-474f-9c9d-ae493832af75 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:48.569Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31c9030e-b59e-474f-9c9d-ae493832af75 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=503 EndTimestamp=2021-07-13T00:28:48.568Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:48.065Z InvocationID=48960ab4-ed4b-499b-9f26-23b96f025eb8 ResponseDesc=OK 2021-07-13T00:28:48.874Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9894a76d-ac8c-43a1-87f8-b6971b1f7b67 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:48.874Z InvocationID=38f80205-0e95-4a1d-9644-787a2635051d 2021-07-13T00:28:50.766Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d61e78a-0af5-4bee-afe5-60f0b985a535 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:50.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:50.765Z InvocationID=bf3f0e0c-f781-4d20-b7c4-0b99b52a476d 2021-07-13T00:28:51.359Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d61e78a-0af5-4bee-afe5-60f0b985a535 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:51.425Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9894a76d-ac8c-43a1-87f8-b6971b1f7b67 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:51.561Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d61e78a-0af5-4bee-afe5-60f0b985a535 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=796 EndTimestamp=2021-07-13T00:28:51.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:50.765Z InvocationID=ba23a1e7-9a2a-4f4e-a18c-f5baeb6e26a3 ResponseDesc=OK 2021-07-13T00:28:51.757Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9894a76d-ac8c-43a1-87f8-b6971b1f7b67 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2883 EndTimestamp=2021-07-13T00:28:51.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:48.874Z InvocationID=ca21f7fa-604e-44f2-85fb-f95d302a1364 ResponseDesc=OK 2021-07-13T00:28:53.669Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c11eb2c7-0fac-4219-9eab-d679abea2613 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:53.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:53.669Z InvocationID=1e2c1bfe-082a-446a-ba9f-810237efb7a0 2021-07-13T00:28:53.758Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c11eb2c7-0fac-4219-9eab-d679abea2613 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:54.347Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c11eb2c7-0fac-4219-9eab-d679abea2613 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=678 EndTimestamp=2021-07-13T00:28:54.347Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:53.669Z InvocationID=7c5ecc03-cb3e-4801-8bfc-131c7e6a2057 ResponseDesc=OK 2021-07-13T00:28:56.776Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=beff98a8-17b9-4ed2-9d57-ddeee62b02a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:56.775Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:56.775Z InvocationID=4e255e7c-cfa1-42cb-aa78-ab43476df804 2021-07-13T00:28:57.315Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=beff98a8-17b9-4ed2-9d57-ddeee62b02a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:57.440Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3bf87bf1-be6d-4a13-8b53-029ec66e4f4e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:57.440Z InvocationID=938feb74-8c50-43ce-955d-5209696958c0 2021-07-13T00:28:57.557Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3bf87bf1-be6d-4a13-8b53-029ec66e4f4e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:57.559Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=beff98a8-17b9-4ed2-9d57-ddeee62b02a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=784 EndTimestamp=2021-07-13T00:28:57.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:56.775Z InvocationID=080718ca-6db0-4a49-a78c-36b6779814b1 ResponseDesc=OK 2021-07-13T00:28:58.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eb0af5ba-b9eb-4e8f-9f59-9dda04250fb9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:58.874Z InvocationID=4d23ad57-9fe4-4481-adf2-016d29e3226c 2021-07-13T00:28:58.960Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eb0af5ba-b9eb-4e8f-9f59-9dda04250fb9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:28:58.960Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3bf87bf1-be6d-4a13-8b53-029ec66e4f4e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1520 EndTimestamp=2021-07-13T00:28:58.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:57.440Z InvocationID=abf1fc0e-4d08-4303-ad52-02f32dbabaf9 ResponseDesc=OK 2021-07-13T00:28:59.316Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eb0af5ba-b9eb-4e8f-9f59-9dda04250fb9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=442 EndTimestamp=2021-07-13T00:28:59.316Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:58.874Z InvocationID=dc260129-4ab7-4fdf-abac-17a8105e7812 ResponseDesc=OK 2021-07-13T00:28:59.870Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=13e73501-c3ca-450c-bdca-23e4071dc148 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:28:59.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:59.870Z InvocationID=bcceb83d-ce90-483f-ba79-2e52bf9a2017 2021-07-13T00:29:00.417Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=13e73501-c3ca-450c-bdca-23e4071dc148 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:00.660Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=13e73501-c3ca-450c-bdca-23e4071dc148 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=790 EndTimestamp=2021-07-13T00:29:00.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:28:59.870Z InvocationID=904479cc-f88e-4ed0-a3a0-8566b1fb4251 ResponseDesc=OK 2021-07-13T00:29:03.264Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31faa795-3626-4cdd-b07c-0f47797b508a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:03.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:03.264Z InvocationID=06f88ce4-90d9-464d-93e1-8d0468c91ecc 2021-07-13T00:29:03.785Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31faa795-3626-4cdd-b07c-0f47797b508a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:04.258Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31faa795-3626-4cdd-b07c-0f47797b508a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=993 EndTimestamp=2021-07-13T00:29:04.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:03.264Z InvocationID=fdb18300-b5ac-429f-81a9-5f56d9c61c32 ResponseDesc=OK 2021-07-13T00:29:05.861Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9d65c336-3f68-4f8f-b13b-304045f356c2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:05.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:05.861Z InvocationID=ebfd4a5a-fec0-40a7-889d-10d453ba2e20 2021-07-13T00:29:06.059Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9d65c336-3f68-4f8f-b13b-304045f356c2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:06.411Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9d65c336-3f68-4f8f-b13b-304045f356c2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=550 EndTimestamp=2021-07-13T00:29:06.411Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:05.861Z InvocationID=9c669b8d-89b9-4997-a60b-97109ac51e48 ResponseDesc=OK 2021-07-13T00:29:07.440Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e9d0e526-6daa-46c7-9473-c1d237762c33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:07.439Z InvocationID=774f73d7-1061-440e-a463-28f28cbb27e2 2021-07-13T00:29:07.714Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e9d0e526-6daa-46c7-9473-c1d237762c33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:07.960Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e9d0e526-6daa-46c7-9473-c1d237762c33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=521 EndTimestamp=2021-07-13T00:29:07.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:07.439Z InvocationID=6a2f04a4-8d35-4168-bce0-eae652b458a1 ResponseDesc=OK 2021-07-13T00:29:08.765Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2cb263a6-5617-4586-b8b3-5f5627539133 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:08.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:08.765Z InvocationID=87da94ca-30bf-4298-855e-c21e7de8650f 2021-07-13T00:29:08.873Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b8e9a0de-0e49-454a-8689-3d6ff0591458 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:08.873Z InvocationID=48a51708-266a-4c63-8995-b8a8984c2e46 2021-07-13T00:29:08.956Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2cb263a6-5617-4586-b8b3-5f5627539133 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:09.519Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b8e9a0de-0e49-454a-8689-3d6ff0591458 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:09.557Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2cb263a6-5617-4586-b8b3-5f5627539133 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=792 EndTimestamp=2021-07-13T00:29:09.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:08.765Z InvocationID=ccc4b3ff-032f-46df-b23f-d383567c10d1 ResponseDesc=OK 2021-07-13T00:29:10.124Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b8e9a0de-0e49-454a-8689-3d6ff0591458 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1251 EndTimestamp=2021-07-13T00:29:10.124Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:08.873Z InvocationID=5817ed82-cd55-432f-bf15-0a9189d1e8b4 ResponseDesc=OK 2021-07-13T00:29:11.877Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=45bdf909-f6bc-4ae7-aee2-71376afcbc09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:11.877Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:11.877Z InvocationID=15b2a473-2b49-4599-be9b-9a667c8e0915 2021-07-13T00:29:12.434Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=45bdf909-f6bc-4ae7-aee2-71376afcbc09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:12.659Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=45bdf909-f6bc-4ae7-aee2-71376afcbc09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=782 EndTimestamp=2021-07-13T00:29:12.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:11.877Z InvocationID=ecd0d320-19ac-4169-ae8a-02cbc6ce27ba ResponseDesc=OK 2021-07-13T00:29:15.365Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=645d7560-212b-4b4b-84b1-30e02d4271f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:15.365Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:15.365Z InvocationID=08b93bb0-c841-4018-b774-9826c908e887 2021-07-13T00:29:15.557Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=645d7560-212b-4b4b-84b1-30e02d4271f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:16.859Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=645d7560-212b-4b4b-84b1-30e02d4271f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1494 EndTimestamp=2021-07-13T00:29:16.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:15.365Z InvocationID=805bf2ea-d05e-458e-8a08-f7a1dc5db6e2 ResponseDesc=OK 2021-07-13T00:29:17.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=72fb6a1d-57f2-422c-ae6a-ed18d1829c39 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:17.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:17.440Z InvocationID=160a3229-5d47-46a7-975c-f1be82f2e547 2021-07-13T00:29:17.559Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=72fb6a1d-57f2-422c-ae6a-ed18d1829c39 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:17.675Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=78a9c147-e5df-41e8-b89b-87cf724a2bbe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:17.675Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:17.675Z InvocationID=48d6d94e-a401-4e4d-8e0e-10f914f4da69 2021-07-13T00:29:18.315Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=72fb6a1d-57f2-422c-ae6a-ed18d1829c39 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=874 EndTimestamp=2021-07-13T00:29:18.314Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:17.440Z InvocationID=fbaa5531-bad3-4950-ab2b-bd82c9648144 ResponseDesc=OK 2021-07-13T00:29:18.372Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=78a9c147-e5df-41e8-b89b-87cf724a2bbe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:18.468Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=78a9c147-e5df-41e8-b89b-87cf724a2bbe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=793 EndTimestamp=2021-07-13T00:29:18.468Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:17.675Z InvocationID=38531e1a-3674-4d11-91f4-25ee23eea57c ResponseDesc=OK 2021-07-13T00:29:18.875Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=92fafb41-0cff-4cc9-b51c-3439f897ddba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:18.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:18.875Z InvocationID=a06d2013-4d2e-4b68-921a-efbe5e279a11 2021-07-13T00:29:19.057Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=92fafb41-0cff-4cc9-b51c-3439f897ddba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:20.058Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=92fafb41-0cff-4cc9-b51c-3439f897ddba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1183 EndTimestamp=2021-07-13T00:29:20.058Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:18.875Z InvocationID=f098b5a8-fb14-41b2-a9c8-43e5049f049f ResponseDesc=OK 2021-07-13T00:29:21.269Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cb72bed1-df77-4909-935b-73d2f0965eea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:21.268Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:21.268Z InvocationID=f37090d3-bc8b-4202-b91b-3c1a3989768c 2021-07-13T00:29:21.359Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cb72bed1-df77-4909-935b-73d2f0965eea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:23.364Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cb72bed1-df77-4909-935b-73d2f0965eea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2096 EndTimestamp=2021-07-13T00:29:23.364Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:21.268Z InvocationID=8e551cf8-98ff-4637-bcaf-7f02eefc570e ResponseDesc=OK 2021-07-13T00:29:24.459Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b7a8b621-cd9c-4a2b-a7f1-d48d1abeb9dd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:24.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:24.459Z InvocationID=62e151a6-66c0-4e15-b22c-1071d776ed11 2021-07-13T00:29:24.918Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b7a8b621-cd9c-4a2b-a7f1-d48d1abeb9dd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:25.163Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b7a8b621-cd9c-4a2b-a7f1-d48d1abeb9dd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=704 EndTimestamp=2021-07-13T00:29:25.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:24.459Z InvocationID=db588206-4b6f-4350-87aa-ce8010c18e74 ResponseDesc=OK 2021-07-13T00:29:27.261Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b3485ddb-6902-4164-a0c5-d12cd6a21efe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:27.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:27.261Z InvocationID=6563f91f-72ef-4724-9dfd-6833ea111a40 2021-07-13T00:29:27.442Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1f2595fc-0942-446d-ac5e-b0e7d3c2863a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:27.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:27.442Z InvocationID=f92bb2c2-105b-4b42-98bc-691d1509a25b 2021-07-13T00:29:27.723Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1f2595fc-0942-446d-ac5e-b0e7d3c2863a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:27.757Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b3485ddb-6902-4164-a0c5-d12cd6a21efe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:27.958Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1f2595fc-0942-446d-ac5e-b0e7d3c2863a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=516 EndTimestamp=2021-07-13T00:29:27.958Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:27.442Z InvocationID=b6f4811d-ce8b-492e-81b4-097f173146ed ResponseDesc=OK 2021-07-13T00:29:28.112Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b3485ddb-6902-4164-a0c5-d12cd6a21efe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=851 EndTimestamp=2021-07-13T00:29:28.112Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:27.261Z InvocationID=996c178a-41d2-4cb7-b82b-7cf4de3a75d2 ResponseDesc=OK 2021-07-13T00:29:28.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da092754-a673-4517-9e96-f3e5f507bae2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:28.874Z InvocationID=62dff0b1-1855-4c0a-8ded-28d92b159bf9 2021-07-13T00:29:29.142Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da092754-a673-4517-9e96-f3e5f507bae2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:29.359Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da092754-a673-4517-9e96-f3e5f507bae2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=485 EndTimestamp=2021-07-13T00:29:29.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:28.874Z InvocationID=993a1241-615d-452f-bce5-9cab425468c9 ResponseDesc=OK 2021-07-13T00:29:29.590Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=00938994-b812-4cfd-865e-441ffd219ac2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:29.590Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:29.590Z InvocationID=de774ebf-30aa-4f6f-a6fd-9fe5f98d236d 2021-07-13T00:29:29.757Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=00938994-b812-4cfd-865e-441ffd219ac2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:30.157Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=00938994-b812-4cfd-865e-441ffd219ac2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=567 EndTimestamp=2021-07-13T00:29:30.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:29.590Z InvocationID=3d40e504-38d4-4e50-9491-48fa22ff0783 ResponseDesc=OK 2021-07-13T00:29:32.967Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=34df6d65-a26e-44a8-8145-a9c332abfa6c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:32.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:32.967Z InvocationID=1ebdeb50-bf27-4974-b608-4b89d836f08c 2021-07-13T00:29:33.060Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=34df6d65-a26e-44a8-8145-a9c332abfa6c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:33.416Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=34df6d65-a26e-44a8-8145-a9c332abfa6c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=448 EndTimestamp=2021-07-13T00:29:33.415Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:32.967Z InvocationID=e5f54c13-bb7a-4c7b-9b82-c4f15950ba23 ResponseDesc=OK 2021-07-13T00:29:35.969Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6eeed190-eebf-414e-a1f5-2f2430fbadbc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:35.969Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:35.969Z InvocationID=ec187a79-63af-4471-9d7f-c5b333248dcb 2021-07-13T00:29:36.219Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6eeed190-eebf-414e-a1f5-2f2430fbadbc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:36.370Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6eeed190-eebf-414e-a1f5-2f2430fbadbc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=401 EndTimestamp=2021-07-13T00:29:36.370Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:35.969Z InvocationID=19ec62e5-5968-48b7-acde-11630d678c9e ResponseDesc=OK 2021-07-13T00:29:37.441Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a54c5b56-ff77-402a-84a2-1f143558f0e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:37.440Z InvocationID=353aa78f-7108-4476-853c-ca8e370830e0 2021-07-13T00:29:37.572Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a54c5b56-ff77-402a-84a2-1f143558f0e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:37.858Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a54c5b56-ff77-402a-84a2-1f143558f0e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=418 EndTimestamp=2021-07-13T00:29:37.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:37.440Z InvocationID=d28eac83-93ec-4af2-a03d-5c351f396697 ResponseDesc=OK 2021-07-13T00:29:38.875Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8e39c675-8130-441a-96ba-c8617721776c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:38.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:38.875Z InvocationID=e0294f51-4be7-4f7e-a2d6-e3f58dba409b 2021-07-13T00:29:38.960Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8e39c675-8130-441a-96ba-c8617721776c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:39.163Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=25808fea-1b15-45b4-86ab-0a536c9f87d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:39.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:39.163Z InvocationID=c13471cd-20d8-40c7-a411-4bbaabc7eee4 2021-07-13T00:29:39.418Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=25808fea-1b15-45b4-86ab-0a536c9f87d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:39.419Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8e39c675-8130-441a-96ba-c8617721776c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=544 EndTimestamp=2021-07-13T00:29:39.419Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:38.875Z InvocationID=d2cd87b4-1dd1-4713-a042-967c40c537f2 ResponseDesc=OK 2021-07-13T00:29:39.660Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=25808fea-1b15-45b4-86ab-0a536c9f87d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:29:39.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:39.163Z InvocationID=a265e42f-8da1-4d13-9982-6fa71d969566 ResponseDesc=OK 2021-07-13T00:29:41.276Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f334d738-48b4-4859-b0ca-2a4464e76093 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:41.276Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:41.276Z InvocationID=e132c61e-28f4-4f45-96da-65bd019fce70 2021-07-13T00:29:41.462Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f334d738-48b4-4859-b0ca-2a4464e76093 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:42.057Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f334d738-48b4-4859-b0ca-2a4464e76093 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=781 EndTimestamp=2021-07-13T00:29:42.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:41.276Z InvocationID=54d2b954-1070-4cdf-a4df-7865e6ca13c8 ResponseDesc=OK 2021-07-13T00:29:44.963Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5808bbb4-080f-4f91-b210-d8373b777ff6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:44.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:44.963Z InvocationID=c7d6fa30-44ce-4046-88e3-d6e89fbc8643 2021-07-13T00:29:45.059Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5808bbb4-080f-4f91-b210-d8373b777ff6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:45.323Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5808bbb4-080f-4f91-b210-d8373b777ff6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=360 EndTimestamp=2021-07-13T00:29:45.323Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:44.963Z InvocationID=c6215d90-97ab-4f65-b8fd-7f07f7d7d565 ResponseDesc=OK 2021-07-13T00:29:47.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=91847230-5116-4f65-98fa-fa01b653e2f3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:47.440Z InvocationID=aed8f93b-a8d9-41b1-b00e-57374fbcfd94 2021-07-13T00:29:48.065Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2fd89a65-11be-4d59-9ff8-c6d47747ad78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:48.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:48.065Z InvocationID=919585ac-0e5e-4173-a3eb-7e96b1f5f5f9 2021-07-13T00:29:48.111Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=91847230-5116-4f65-98fa-fa01b653e2f3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:48.159Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2fd89a65-11be-4d59-9ff8-c6d47747ad78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:48.360Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=91847230-5116-4f65-98fa-fa01b653e2f3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=920 EndTimestamp=2021-07-13T00:29:48.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:47.440Z InvocationID=da1100e0-7244-46db-a30f-728b2d87dd8c ResponseDesc=OK 2021-07-13T00:29:48.557Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2fd89a65-11be-4d59-9ff8-c6d47747ad78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=492 EndTimestamp=2021-07-13T00:29:48.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:48.065Z InvocationID=9316988d-dd8a-4281-9e60-64538843a39d ResponseDesc=OK 2021-07-13T00:29:48.875Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=06dae33d-64a4-47ad-a81e-42b77af4130b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:48.875Z InvocationID=5eea11c3-b016-4466-a4cd-459fb80c3b9c 2021-07-13T00:29:48.964Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=06dae33d-64a4-47ad-a81e-42b77af4130b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:49.431Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=06dae33d-64a4-47ad-a81e-42b77af4130b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=556 EndTimestamp=2021-07-13T00:29:49.431Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:48.875Z InvocationID=dc581e43-bfa7-48a7-9e6c-c8eb8a5c198f ResponseDesc=OK 2021-07-13T00:29:50.964Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9ae86a25-1b4e-4aa4-b5de-4fd79845e8ce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:50.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:50.964Z InvocationID=b2305be5-c4db-4b75-91e0-8403934b1fbd 2021-07-13T00:29:51.134Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9ae86a25-1b4e-4aa4-b5de-4fd79845e8ce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:51.271Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9ae86a25-1b4e-4aa4-b5de-4fd79845e8ce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=307 EndTimestamp=2021-07-13T00:29:51.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:50.964Z InvocationID=e5a852b0-bdbd-4a33-a33d-7da171f7237b ResponseDesc=OK 2021-07-13T00:29:53.866Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=409a4823-307e-4cd8-988d-a754b456867d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:53.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:53.866Z InvocationID=b0eea366-5fd6-4d28-a342-565b057287ad 2021-07-13T00:29:54.056Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=409a4823-307e-4cd8-988d-a754b456867d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:54.359Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=409a4823-307e-4cd8-988d-a754b456867d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=493 EndTimestamp=2021-07-13T00:29:54.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:53.866Z InvocationID=970e2fff-5dbb-4eb5-b6a2-d20b971b24f8 ResponseDesc=OK 2021-07-13T00:29:56.768Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=95cd0ee4-39f2-4978-ae21-1b7bb917d2df InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:56.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:56.768Z InvocationID=b3142858-f628-448d-8417-b699be17e5cd 2021-07-13T00:29:56.859Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=95cd0ee4-39f2-4978-ae21-1b7bb917d2df InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:29:57.440Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=46bbe805-829c-46f6-94b6-8825cec7ceb5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:57.440Z InvocationID=91513813-5bf5-4bde-a0a6-91809ea27248 2021-07-13T00:29:58.874Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=62df8a80-0995-465e-aba9-e6e889f31141 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:29:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:58.874Z InvocationID=deb9dced-2204-4270-b60f-2fd382631e54 2021-07-13T00:30:00.459Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=62df8a80-0995-465e-aba9-e6e889f31141 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:00.529Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=95cd0ee4-39f2-4978-ae21-1b7bb917d2df InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3761 EndTimestamp=2021-07-13T00:30:00.529Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:56.768Z InvocationID=811b6b3b-e45b-4e50-b3f2-e4543b16517e ResponseDesc=OK 2021-07-13T00:30:01.306Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cd8d4668-fba5-4b5b-96d5-a410c8b80769 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:01.305Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:01.305Z InvocationID=022ece1f-bb59-4e85-a604-6bbb26d4e2d4 2021-07-13T00:30:01.559Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=62df8a80-0995-465e-aba9-e6e889f31141 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2685 EndTimestamp=2021-07-13T00:30:01.559Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:58.874Z InvocationID=384ac51f-9d8a-4f21-8f12-a663c2c9afba ResponseDesc=OK 2021-07-13T00:30:01.561Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=46bbe805-829c-46f6-94b6-8825cec7ceb5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:01.711Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cd8d4668-fba5-4b5b-96d5-a410c8b80769 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:01.759Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=46bbe805-829c-46f6-94b6-8825cec7ceb5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4319 EndTimestamp=2021-07-13T00:30:01.759Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:29:57.440Z InvocationID=d8360203-7996-45f7-b1fb-ac10adf5ad0d ResponseDesc=OK 2021-07-13T00:30:02.463Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cd8d4668-fba5-4b5b-96d5-a410c8b80769 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1158 EndTimestamp=2021-07-13T00:30:02.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:01.305Z InvocationID=f656d857-73a1-4491-b658-c7f6d8481f44 ResponseDesc=OK 2021-07-13T00:30:03.266Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=11b5071a-721a-41ea-9be8-00f2716c5767 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:03.266Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:03.266Z InvocationID=ccc38d7a-f602-4042-b5c6-1db827cadec4 2021-07-13T00:30:03.362Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=11b5071a-721a-41ea-9be8-00f2716c5767 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:03.379Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=11b5071a-721a-41ea-9be8-00f2716c5767 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=113 EndTimestamp=2021-07-13T00:30:03.379Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:03.266Z InvocationID=997e3c9f-3568-4375-9828-790b936b1dea ResponseDesc=OK 2021-07-13T00:30:05.964Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a7680966-fab5-4f17-bc9b-a27f63cd9de9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:05.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:05.964Z InvocationID=8d6ac2b9-a102-4477-9795-1c9ac4188cf1 2021-07-13T00:30:06.157Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a7680966-fab5-4f17-bc9b-a27f63cd9de9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:06.468Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a7680966-fab5-4f17-bc9b-a27f63cd9de9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=504 EndTimestamp=2021-07-13T00:30:06.468Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:05.964Z InvocationID=0896f669-9ed2-4748-a395-856f25cd4e86 ResponseDesc=OK 2021-07-13T00:30:07.440Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1d046772-6543-458c-9d02-59bac5b3c8be InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:07.440Z InvocationID=d2f352da-6039-4f29-a3ea-d467e1d8f082 2021-07-13T00:30:07.559Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1d046772-6543-458c-9d02-59bac5b3c8be InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:08.067Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1d046772-6543-458c-9d02-59bac5b3c8be InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=627 EndTimestamp=2021-07-13T00:30:08.067Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:07.440Z InvocationID=f94973f0-92fe-4646-9247-c4b3ccccb972 ResponseDesc=OK 2021-07-13T00:30:08.874Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=06a0578a-52ec-499d-90d0-94680f767cd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:08.874Z InvocationID=678900c6-6792-45d0-a30c-6ae1652bc2a3 2021-07-13T00:30:09.068Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=539205b1-c250-4098-9596-a6373e7021e2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:09.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:09.068Z InvocationID=640f361d-36e3-42a3-97cd-253dcc932bcf 2021-07-13T00:30:09.460Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=539205b1-c250-4098-9596-a6373e7021e2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:09.460Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=06a0578a-52ec-499d-90d0-94680f767cd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:09.561Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=539205b1-c250-4098-9596-a6373e7021e2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=493 EndTimestamp=2021-07-13T00:30:09.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:09.068Z InvocationID=716b1d9d-fb2f-4f83-9c8a-541d9f89a8ab ResponseDesc=OK 2021-07-13T00:30:09.662Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=06a0578a-52ec-499d-90d0-94680f767cd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=788 EndTimestamp=2021-07-13T00:30:09.662Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:08.874Z InvocationID=985cd414-18cf-4d74-a8b7-d399aeb9ddc2 ResponseDesc=OK 2021-07-13T00:30:12.070Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d68e9dfd-e582-4bdd-90cf-b3161bcf811c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:12.070Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:12.070Z InvocationID=e4268e7d-3304-4fbd-98d8-21bc6524b741 2021-07-13T00:30:12.159Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d68e9dfd-e582-4bdd-90cf-b3161bcf811c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:12.271Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d68e9dfd-e582-4bdd-90cf-b3161bcf811c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=201 EndTimestamp=2021-07-13T00:30:12.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:12.070Z InvocationID=916261c8-a27c-41b5-a6bc-cd5ca0e98285 ResponseDesc=OK 2021-07-13T00:30:14.481Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5d368237-ac4a-4471-a7c8-6e376b26f850 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:14.481Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:14.481Z InvocationID=b650e50e-2017-4983-ba4a-a221d001bd16 2021-07-13T00:30:14.613Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5d368237-ac4a-4471-a7c8-6e376b26f850 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:15.960Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5d368237-ac4a-4471-a7c8-6e376b26f850 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1479 EndTimestamp=2021-07-13T00:30:15.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:14.481Z InvocationID=5b37ec53-9842-4ba8-8539-e7b9f42fe3fa ResponseDesc=OK 2021-07-13T00:30:17.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b35a6f61-b856-4fa3-8125-449ce2232f08 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:17.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:17.440Z InvocationID=cd384cfe-b40e-436d-87c4-d7815b141d09 2021-07-13T00:30:17.557Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b35a6f61-b856-4fa3-8125-449ce2232f08 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:17.957Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b35a6f61-b856-4fa3-8125-449ce2232f08 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=517 EndTimestamp=2021-07-13T00:30:17.957Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:17.440Z InvocationID=ce151c5c-2d2f-4094-a139-80174f259567 ResponseDesc=OK 2021-07-13T00:30:17.971Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f999b7ee-5189-44aa-adf5-481d675e9f2e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:17.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:17.971Z InvocationID=e3c0e71a-2160-4f2f-bf68-4e73c9ebfc41 2021-07-13T00:30:18.060Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f999b7ee-5189-44aa-adf5-481d675e9f2e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:18.874Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31be66db-875c-465d-b69e-9c8be14f45b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:18.874Z InvocationID=5b22286b-7dc4-41a5-8a87-9840a094b6db 2021-07-13T00:30:20.819Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f999b7ee-5189-44aa-adf5-481d675e9f2e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2848 EndTimestamp=2021-07-13T00:30:20.819Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:17.971Z InvocationID=460ccc36-d314-47a4-a04d-1e144c9bd09e ResponseDesc=OK 2021-07-13T00:30:20.918Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31be66db-875c-465d-b69e-9c8be14f45b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:21.260Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31be66db-875c-465d-b69e-9c8be14f45b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2386 EndTimestamp=2021-07-13T00:30:21.260Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:18.874Z InvocationID=52e8444e-735c-4bf5-a3a2-dfd74d22384b ResponseDesc=OK 2021-07-13T00:30:22.074Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c98ce591-ef19-4d97-be68-5e1237c89dc5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:22.074Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:22.074Z InvocationID=6ca9b085-6326-4242-a334-fb55a2710d85 2021-07-13T00:30:22.215Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c98ce591-ef19-4d97-be68-5e1237c89dc5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:22.558Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c98ce591-ef19-4d97-be68-5e1237c89dc5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=484 EndTimestamp=2021-07-13T00:30:22.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:22.074Z InvocationID=dc2c1057-e1bd-45b4-80b7-765ccdfa85b1 ResponseDesc=OK 2021-07-13T00:30:23.963Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d01d865e-bac8-4b9b-922d-ea48e921912b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:23.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:23.963Z InvocationID=2faf2407-317f-4c43-96ce-bb93b1b58e25 2021-07-13T00:30:24.259Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d01d865e-bac8-4b9b-922d-ea48e921912b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:24.612Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d01d865e-bac8-4b9b-922d-ea48e921912b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=649 EndTimestamp=2021-07-13T00:30:24.612Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:23.963Z InvocationID=7b21b7fe-1c6b-47b3-84e2-40e5d7b92058 ResponseDesc=OK 2021-07-13T00:30:26.663Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=28eb3f93-44be-49c2-83d3-528a83d79ff5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:26.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:26.663Z InvocationID=9b672f13-637c-49e4-8a4d-6669b5242140 2021-07-13T00:30:26.926Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=28eb3f93-44be-49c2-83d3-528a83d79ff5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:27.416Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=28eb3f93-44be-49c2-83d3-528a83d79ff5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=753 EndTimestamp=2021-07-13T00:30:27.416Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:26.663Z InvocationID=b281c3cd-3e9f-4bc4-9b4b-0e30ac1f826f ResponseDesc=OK 2021-07-13T00:30:27.440Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5a96ed4c-f7c3-435f-8794-c1466c02be03 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:27.440Z InvocationID=5ab058d4-a129-4428-943e-cdfe7691b739 2021-07-13T00:30:27.557Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5a96ed4c-f7c3-435f-8794-c1466c02be03 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:28.874Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=77e45f45-c42a-4aa9-ad51-a9141e73e89c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:28.874Z InvocationID=ad04e619-53b5-4d58-9f8e-776252b1a97a 2021-07-13T00:30:29.358Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5a96ed4c-f7c3-435f-8794-c1466c02be03 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1917 EndTimestamp=2021-07-13T00:30:29.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:27.440Z InvocationID=5e4bedef-2df0-4827-b9a1-3916224d4a21 ResponseDesc=OK 2021-07-13T00:30:29.358Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=77e45f45-c42a-4aa9-ad51-a9141e73e89c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:29.712Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=77e45f45-c42a-4aa9-ad51-a9141e73e89c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=838 EndTimestamp=2021-07-13T00:30:29.712Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:28.874Z InvocationID=8ee808d9-ab84-4ebc-a2c9-4ca56116b8e9 ResponseDesc=OK 2021-07-13T00:30:29.874Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=25a44770-77dd-409e-b3de-5ddee33197f6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:29.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:29.873Z InvocationID=e095d513-fcff-484b-a27d-7e8ac6c3f18e 2021-07-13T00:30:31.067Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=25a44770-77dd-409e-b3de-5ddee33197f6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:31.260Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=25a44770-77dd-409e-b3de-5ddee33197f6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1387 EndTimestamp=2021-07-13T00:30:31.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:29.873Z InvocationID=6d7f8f15-e340-49cc-a7d2-f1075b1ac280 ResponseDesc=OK 2021-07-13T00:30:32.873Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bd9a8138-eb53-4738-891d-1f775e4740e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:32.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:32.873Z InvocationID=18f9d41d-f11e-4540-827b-afe212751fca 2021-07-13T00:30:33.057Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bd9a8138-eb53-4738-891d-1f775e4740e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:34.263Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bd9a8138-eb53-4738-891d-1f775e4740e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1389 EndTimestamp=2021-07-13T00:30:34.262Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:32.873Z InvocationID=74973239-2f7a-4f63-999e-10e5b3bba929 ResponseDesc=OK 2021-07-13T00:30:35.676Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8741ddd8-9afc-45ad-b426-12e9af944021 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:35.676Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:35.676Z InvocationID=2bc19417-c006-4afc-8125-10c34825be05 2021-07-13T00:30:35.765Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8741ddd8-9afc-45ad-b426-12e9af944021 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:37.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b2cc8248-4560-405e-a17b-121aeae5a025 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:37.440Z InvocationID=d2a69ea5-2fbe-4c6f-ba45-6dcec3d76695 2021-07-13T00:30:37.764Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8741ddd8-9afc-45ad-b426-12e9af944021 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2088 EndTimestamp=2021-07-13T00:30:37.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:35.676Z InvocationID=16c7542d-d71c-4118-bbbd-a4769c9b140b ResponseDesc=OK 2021-07-13T00:30:37.876Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b2cc8248-4560-405e-a17b-121aeae5a025 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:38.460Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b2cc8248-4560-405e-a17b-121aeae5a025 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1020 EndTimestamp=2021-07-13T00:30:38.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:37.440Z InvocationID=0c171b40-5dc3-4ede-97a6-9ac5d6ca8d5e ResponseDesc=OK 2021-07-13T00:30:38.874Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=42f15d90-beb8-4f05-b1b5-8af49f8a9610 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:38.873Z InvocationID=7f77d50b-e847-443b-adb7-486b55e64e5d 2021-07-13T00:30:39.056Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=42f15d90-beb8-4f05-b1b5-8af49f8a9610 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:39.180Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=39e661c5-29d7-4eab-8cd6-0455332883a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:39.180Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:39.180Z InvocationID=5879e9df-2df0-4b96-a83e-ae6f671c770e 2021-07-13T00:30:39.359Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=39e661c5-29d7-4eab-8cd6-0455332883a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:39.465Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=39e661c5-29d7-4eab-8cd6-0455332883a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=285 EndTimestamp=2021-07-13T00:30:39.465Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:39.180Z InvocationID=c2184353-56e5-48ef-b4ff-b34dff8ec625 ResponseDesc=OK 2021-07-13T00:30:40.729Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=42f15d90-beb8-4f05-b1b5-8af49f8a9610 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1856 EndTimestamp=2021-07-13T00:30:40.729Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:38.873Z InvocationID=263c866c-a091-4242-b588-524c27ee4d68 ResponseDesc=OK 2021-07-13T00:30:42.065Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=40741a58-c294-4f6e-be74-66d845aa8683 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:42.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:42.065Z InvocationID=37d9e284-084e-4413-9494-f933c98e43e0 2021-07-13T00:30:42.470Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=40741a58-c294-4f6e-be74-66d845aa8683 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:42.660Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=40741a58-c294-4f6e-be74-66d845aa8683 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=595 EndTimestamp=2021-07-13T00:30:42.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:42.065Z InvocationID=7355e7d9-0fb8-40e3-8af9-33ca772c639d ResponseDesc=OK 2021-07-13T00:30:45.061Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3ff0ee38-c59f-4bd9-bcea-d8cf22a03254 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:45.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:45.061Z InvocationID=5b5fb964-a722-4423-b244-b0013458c733 2021-07-13T00:30:45.156Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3ff0ee38-c59f-4bd9-bcea-d8cf22a03254 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:46.157Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3ff0ee38-c59f-4bd9-bcea-d8cf22a03254 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1096 EndTimestamp=2021-07-13T00:30:46.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:45.061Z InvocationID=fba007e1-1c13-4218-a5e6-62cfa76b01df ResponseDesc=OK 2021-07-13T00:30:47.444Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fd9844f1-7dd6-47dd-809a-53fbe0213855 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:47.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:47.444Z InvocationID=ba1b83e7-7398-4e88-a352-f8be97a6c7d3 2021-07-13T00:30:47.764Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fd9844f1-7dd6-47dd-809a-53fbe0213855 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:48.212Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fd9844f1-7dd6-47dd-809a-53fbe0213855 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=768 EndTimestamp=2021-07-13T00:30:48.212Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:47.444Z InvocationID=6d8ad224-75dc-489b-8f54-362ffb6d6167 ResponseDesc=OK 2021-07-13T00:30:48.664Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a2c5b1ec-1f93-4d6a-9aa4-9faadd569db1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:48.664Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:48.664Z InvocationID=1882a3c7-6cde-4f73-9a66-935e9793e33d 2021-07-13T00:30:48.874Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bf2782b1-dcb2-4236-a77c-68b2324db126 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:48.874Z InvocationID=9c5515c6-c599-4398-af18-a6d4588f41cf 2021-07-13T00:30:49.359Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bf2782b1-dcb2-4236-a77c-68b2324db126 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:49.363Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a2c5b1ec-1f93-4d6a-9aa4-9faadd569db1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:49.760Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bf2782b1-dcb2-4236-a77c-68b2324db126 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=886 EndTimestamp=2021-07-13T00:30:49.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:48.874Z InvocationID=0d389def-3604-4838-8910-1139dd4754e4 ResponseDesc=OK 2021-07-13T00:30:51.859Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a2c5b1ec-1f93-4d6a-9aa4-9faadd569db1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3194 EndTimestamp=2021-07-13T00:30:51.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:48.664Z InvocationID=f86e653d-e4dd-45f6-a7c3-2b40149ffbb3 ResponseDesc=OK 2021-07-13T00:30:53.009Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=47e4eee2-eff1-4727-9eac-3613be05a5b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:53.009Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:53.009Z InvocationID=747eef5c-7c8c-4b2e-92f3-1c8f180ca774 2021-07-13T00:30:53.159Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=47e4eee2-eff1-4727-9eac-3613be05a5b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:53.372Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=47e4eee2-eff1-4727-9eac-3613be05a5b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=363 EndTimestamp=2021-07-13T00:30:53.372Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:53.009Z InvocationID=ad5b0e74-2545-4433-9244-410733f9e3da ResponseDesc=OK 2021-07-13T00:30:54.765Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=63d811f8-ffc6-49db-8f60-5abbb01e74bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:54.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:54.765Z InvocationID=ae1e9fa4-388e-4a41-b976-0276ad3c4ad4 2021-07-13T00:30:55.291Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=63d811f8-ffc6-49db-8f60-5abbb01e74bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:55.467Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=63d811f8-ffc6-49db-8f60-5abbb01e74bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=702 EndTimestamp=2021-07-13T00:30:55.467Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:54.765Z InvocationID=9ff6b2d2-c5aa-4254-add7-30d2a89266f1 ResponseDesc=OK 2021-07-13T00:30:57.441Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2989626b-2315-4d19-99b9-aa78b70da0d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:57.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:57.441Z InvocationID=5b3f9f0e-cce6-4f63-8270-11b8058d6ea0 2021-07-13T00:30:57.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2989626b-2315-4d19-99b9-aa78b70da0d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:57.664Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9b8001d8-f672-4e6e-b982-52ba1786506f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:57.664Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:57.664Z InvocationID=5d789263-f267-4e4e-be07-ae94f10737d3 2021-07-13T00:30:57.763Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9b8001d8-f672-4e6e-b982-52ba1786506f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:57.859Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2989626b-2315-4d19-99b9-aa78b70da0d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=417 EndTimestamp=2021-07-13T00:30:57.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:57.441Z InvocationID=62ab77ff-b11e-4d70-ae07-b74440f145d9 ResponseDesc=OK 2021-07-13T00:30:57.964Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9b8001d8-f672-4e6e-b982-52ba1786506f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=300 EndTimestamp=2021-07-13T00:30:57.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:57.664Z InvocationID=866d369a-02cc-4fe7-a87d-e7e23fdafa8a ResponseDesc=OK 2021-07-13T00:30:58.876Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=48480ff9-366f-4a0c-a5d2-4ae91f003a33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:58.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:58.875Z InvocationID=b98cc700-7e3e-4082-b6a1-7092dd4377cc 2021-07-13T00:30:59.114Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=48480ff9-366f-4a0c-a5d2-4ae91f003a33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:30:59.262Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=48480ff9-366f-4a0c-a5d2-4ae91f003a33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=387 EndTimestamp=2021-07-13T00:30:59.262Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:58.875Z InvocationID=a8325058-80d3-4522-a036-6cd9243b89d9 ResponseDesc=OK 2021-07-13T00:30:59.864Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1065416f-bda2-484f-8f3e-c68989b1454c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:30:59.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:59.863Z InvocationID=64fa2c19-c99c-46d5-9e93-03a4ae156654 2021-07-13T00:31:00.056Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1065416f-bda2-484f-8f3e-c68989b1454c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:00.562Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1065416f-bda2-484f-8f3e-c68989b1454c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=699 EndTimestamp=2021-07-13T00:31:00.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:30:59.863Z InvocationID=a8c0ed91-b758-4b89-8ef5-7dbb9a7ca3be ResponseDesc=OK 2021-07-13T00:31:02.963Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6dd247b5-6846-4cda-998f-d58bba2290c9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:02.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:02.963Z InvocationID=ece8f8b4-762e-4fa2-b33d-bf51a1d7539a 2021-07-13T00:31:03.060Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6dd247b5-6846-4cda-998f-d58bba2290c9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:03.319Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6dd247b5-6846-4cda-998f-d58bba2290c9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=356 EndTimestamp=2021-07-13T00:31:03.319Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:02.963Z InvocationID=c354fc01-cbb0-40fd-bdea-8ea25dfd101d ResponseDesc=OK 2021-07-13T00:31:05.768Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b723e6c9-203f-4352-8995-17db91e2f20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:05.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:05.768Z InvocationID=ff744eff-e876-49d5-955a-a6f9574df14c 2021-07-13T00:31:06.178Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b723e6c9-203f-4352-8995-17db91e2f20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:06.272Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b723e6c9-203f-4352-8995-17db91e2f20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=504 EndTimestamp=2021-07-13T00:31:06.272Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:05.768Z InvocationID=85443ab9-3d2f-443b-8a10-f9c6f95574b9 ResponseDesc=OK 2021-07-13T00:31:07.439Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7dd11257-34bc-43d9-96b3-ce6b1c605d8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:07.439Z InvocationID=8ce6eb9c-c21e-43d0-a263-638453335aeb 2021-07-13T00:31:07.861Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7dd11257-34bc-43d9-96b3-ce6b1c605d8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:08.658Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7dd11257-34bc-43d9-96b3-ce6b1c605d8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1219 EndTimestamp=2021-07-13T00:31:08.658Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:07.439Z InvocationID=46f45f37-c228-4720-922b-f164fe4a73df ResponseDesc=OK 2021-07-13T00:31:08.800Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d2271c1a-62a1-49f1-80f7-4f775c351543 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:08.800Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:08.800Z InvocationID=5e070149-3dd0-4d73-ab43-5f7f83d5319c 2021-07-13T00:31:08.874Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da7a3b79-ed39-4823-a7be-9e268d7f4104 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:08.874Z InvocationID=ca6885b0-4aa8-4a91-834e-48b1723dbe4f 2021-07-13T00:31:09.056Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da7a3b79-ed39-4823-a7be-9e268d7f4104 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:09.077Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d2271c1a-62a1-49f1-80f7-4f775c351543 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:09.269Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da7a3b79-ed39-4823-a7be-9e268d7f4104 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=395 EndTimestamp=2021-07-13T00:31:09.269Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:08.874Z InvocationID=807f52a7-70d6-404d-a6b3-7499f0124b99 ResponseDesc=OK 2021-07-13T00:31:09.279Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d2271c1a-62a1-49f1-80f7-4f775c351543 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=479 EndTimestamp=2021-07-13T00:31:09.279Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:08.800Z InvocationID=614f5841-98ca-455b-bcd6-fa12c790eee6 ResponseDesc=OK 2021-07-13T00:31:11.869Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2add034a-7067-493d-8af7-5752e0d10e02 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:11.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:11.869Z InvocationID=1c1321fd-3b62-43f7-b3c5-e3d52b670468 2021-07-13T00:31:11.970Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2add034a-7067-493d-8af7-5752e0d10e02 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:12.357Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2add034a-7067-493d-8af7-5752e0d10e02 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=488 EndTimestamp=2021-07-13T00:31:12.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:11.869Z InvocationID=6d5b239f-21f6-4d55-9dc9-ca7915058a8a ResponseDesc=OK 2021-07-13T00:31:14.763Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e213294c-3825-4776-aea9-cd6903fbec4c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:14.762Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:14.762Z InvocationID=5decf75b-b5b5-4976-9ca3-5d1462c00ea8 2021-07-13T00:31:14.959Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e213294c-3825-4776-aea9-cd6903fbec4c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:15.219Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e213294c-3825-4776-aea9-cd6903fbec4c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=457 EndTimestamp=2021-07-13T00:31:15.219Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:14.762Z InvocationID=b4ce83c3-dc2b-4ae3-a601-6acbcf6a66d1 ResponseDesc=OK 2021-07-13T00:31:17.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=793c6f90-7ca0-4346-8bda-92cac5aae7bf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:17.439Z InvocationID=e7b43e3d-954e-4634-ae39-5c625e9d00ce 2021-07-13T00:31:17.558Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=793c6f90-7ca0-4346-8bda-92cac5aae7bf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:17.761Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=793c6f90-7ca0-4346-8bda-92cac5aae7bf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=321 EndTimestamp=2021-07-13T00:31:17.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:17.439Z InvocationID=3e97323c-c92f-41d3-b853-ede00b4a5600 ResponseDesc=OK 2021-07-13T00:31:18.162Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dea6b44c-bcf9-4702-afc4-5ffea50bd22b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:18.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:18.162Z InvocationID=e7a0960d-a1de-42cf-9ce1-71abf5f840c8 2021-07-13T00:31:18.257Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dea6b44c-bcf9-4702-afc4-5ffea50bd22b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:18.462Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dea6b44c-bcf9-4702-afc4-5ffea50bd22b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=300 EndTimestamp=2021-07-13T00:31:18.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:18.162Z InvocationID=513b3ab5-270a-45ad-af48-f2e9dd4e6f15 ResponseDesc=OK 2021-07-13T00:31:18.874Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1956ae8d-bc1f-4f95-8c7b-06d6ebb01138 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:18.874Z InvocationID=d0358cd2-52eb-4baa-956f-7ce336111c6e 2021-07-13T00:31:18.959Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1956ae8d-bc1f-4f95-8c7b-06d6ebb01138 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:19.415Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1956ae8d-bc1f-4f95-8c7b-06d6ebb01138 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=541 EndTimestamp=2021-07-13T00:31:19.415Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:18.874Z InvocationID=396254d0-7113-4a4f-bcab-59455ff49bdb ResponseDesc=OK 2021-07-13T00:31:20.668Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a0224c98-18e0-4520-b883-f1beedd312a0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:20.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:20.668Z InvocationID=7ad8a27d-733b-440c-bfca-c74c7736008d 2021-07-13T00:31:20.862Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a0224c98-18e0-4520-b883-f1beedd312a0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:21.061Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a0224c98-18e0-4520-b883-f1beedd312a0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=393 EndTimestamp=2021-07-13T00:31:21.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:20.668Z InvocationID=216198cb-1789-4208-b713-cfbd28af9cd4 ResponseDesc=OK 2021-07-13T00:31:23.663Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=67c1ac7e-f55a-494a-924a-a91a2961208a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:23.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:23.663Z InvocationID=eabb8846-5fc9-40d4-81b1-dfb9c646cbaa 2021-07-13T00:31:23.856Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=67c1ac7e-f55a-494a-924a-a91a2961208a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:24.325Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=67c1ac7e-f55a-494a-924a-a91a2961208a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=662 EndTimestamp=2021-07-13T00:31:24.325Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:23.663Z InvocationID=8bd898ab-cef5-49e8-8434-3a250404c0dc ResponseDesc=OK 2021-07-13T00:31:26.964Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d465f14-f79b-4d46-beac-5ec2aeb34949 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:26.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:26.964Z InvocationID=06d4bd17-2a5b-44d5-aab3-8a6c9a7c768c 2021-07-13T00:31:27.063Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d465f14-f79b-4d46-beac-5ec2aeb34949 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:27.264Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2d465f14-f79b-4d46-beac-5ec2aeb34949 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=300 EndTimestamp=2021-07-13T00:31:27.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:26.964Z InvocationID=e533743b-6346-40c4-bc41-b8d43029a1e2 ResponseDesc=OK 2021-07-13T00:31:27.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a87f09a8-af6d-4dfd-bc0d-23719385733c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:27.440Z InvocationID=957b2f3f-4c7f-4c33-8fde-7a4b107a1092 2021-07-13T00:31:27.612Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a87f09a8-af6d-4dfd-bc0d-23719385733c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:27.960Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a87f09a8-af6d-4dfd-bc0d-23719385733c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=520 EndTimestamp=2021-07-13T00:31:27.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:27.440Z InvocationID=0ec41c29-b207-48fb-96d1-0ebc4f7b0128 ResponseDesc=OK 2021-07-13T00:31:28.874Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=065c3486-02e9-417e-a608-a4d5974e58cc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:28.874Z InvocationID=496d14b2-ae04-4276-8a82-edb5deb6d169 2021-07-13T00:31:29.063Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=065c3486-02e9-417e-a608-a4d5974e58cc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:29.376Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=065c3486-02e9-417e-a608-a4d5974e58cc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=502 EndTimestamp=2021-07-13T00:31:29.376Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:28.874Z InvocationID=6cea292b-7234-420d-b94e-3c9b69d14b60 ResponseDesc=OK 2021-07-13T00:31:30.062Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3a1d563b-2e9b-4684-bcf6-5b64f71033a4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:30.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:30.062Z InvocationID=9612f67c-5c0c-4065-b3dd-341cbfa78cdd 2021-07-13T00:31:34.009Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6c95e4f5-4156-47e6-8bfe-f616534ff47f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:34.009Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:34.009Z InvocationID=5d539b53-467b-4d21-bbcf-85025531f75d 2021-07-13T00:31:37.444Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d5a68136-0c41-4ec2-a347-eb90e1487e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:37.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:37.444Z InvocationID=af09ae38-64c3-404a-9d47-d76fd2cbe15b 2021-07-13T00:31:38.103Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=743a502d-416b-4f78-a761-2c98f4b7a206 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:38.102Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:38.102Z InvocationID=6dcf0172-9eb5-4eec-8160-544a98324678 2021-07-13T00:31:38.159Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3a1d563b-2e9b-4684-bcf6-5b64f71033a4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:38.160Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6c95e4f5-4156-47e6-8bfe-f616534ff47f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:38.261Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=743a502d-416b-4f78-a761-2c98f4b7a206 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:38.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=69123f67-625a-4ec5-b82b-dab1d3fc0898 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:38.873Z InvocationID=328d822b-697e-42c8-b678-cae68e78bb9d 2021-07-13T00:31:39.019Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=743a502d-416b-4f78-a761-2c98f4b7a206 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=917 EndTimestamp=2021-07-13T00:31:39.019Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:38.102Z InvocationID=de5daefc-5eb2-4621-813f-e078fa63e96c ResponseDesc=OK 2021-07-13T00:31:39.038Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d5a68136-0c41-4ec2-a347-eb90e1487e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:39.058Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=69123f67-625a-4ec5-b82b-dab1d3fc0898 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:39.139Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3a1d563b-2e9b-4684-bcf6-5b64f71033a4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=9077 EndTimestamp=2021-07-13T00:31:39.139Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:30.062Z InvocationID=e95a9d4a-c414-4246-8d6b-2045da844579 ResponseDesc=OK 2021-07-13T00:31:39.157Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6c95e4f5-4156-47e6-8bfe-f616534ff47f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5148 EndTimestamp=2021-07-13T00:31:39.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:34.009Z InvocationID=847e6b0b-8746-4c04-8e4a-9e6f42cec0b4 ResponseDesc=OK 2021-07-13T00:31:39.760Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d5a68136-0c41-4ec2-a347-eb90e1487e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2316 EndTimestamp=2021-07-13T00:31:39.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:37.444Z InvocationID=26d7e20e-46ae-454f-979d-c1c625a31073 ResponseDesc=OK 2021-07-13T00:31:40.103Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=69123f67-625a-4ec5-b82b-dab1d3fc0898 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1230 EndTimestamp=2021-07-13T00:31:40.103Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:38.873Z InvocationID=37025082-4d07-4485-96b4-ce2337ce6299 ResponseDesc=OK 2021-07-13T00:31:40.263Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4d792503-94ef-4dd0-93ff-47cd0e71e793 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:40.263Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:40.263Z InvocationID=531277f1-21ec-4e8e-92c5-36cf1e3e019e 2021-07-13T00:31:40.357Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4d792503-94ef-4dd0-93ff-47cd0e71e793 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:40.870Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4d792503-94ef-4dd0-93ff-47cd0e71e793 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=607 EndTimestamp=2021-07-13T00:31:40.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:40.263Z InvocationID=6b2abd9c-7c11-4274-bde4-494ba1a2c447 ResponseDesc=OK 2021-07-13T00:31:41.768Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cf96bfc1-d29a-4534-85a7-a02ea301e3eb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:41.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:41.768Z InvocationID=75625a89-bf78-4442-a842-b525d8fcded6 2021-07-13T00:31:41.860Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cf96bfc1-d29a-4534-85a7-a02ea301e3eb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:42.120Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cf96bfc1-d29a-4534-85a7-a02ea301e3eb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=352 EndTimestamp=2021-07-13T00:31:42.120Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:41.768Z InvocationID=21a2c8d6-d406-4f53-834d-368fe1ec37a9 ResponseDesc=OK 2021-07-13T00:31:44.675Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=88f28568-541a-4013-a6d9-f0a98c8f2fe6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:44.675Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:44.675Z InvocationID=dba7bf2e-4b5c-4d9a-8dec-0b00a43baeb2 2021-07-13T00:31:45.085Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=88f28568-541a-4013-a6d9-f0a98c8f2fe6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:45.259Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=88f28568-541a-4013-a6d9-f0a98c8f2fe6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=584 EndTimestamp=2021-07-13T00:31:45.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:44.675Z InvocationID=bc6a495d-38ef-4a5c-9b98-480e9f7d0457 ResponseDesc=OK 2021-07-13T00:31:47.439Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f7944f1c-dbf3-46c3-a630-19b54f24b4c6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:47.439Z InvocationID=23fd8152-81b4-433d-aab0-ee8273604811 2021-07-13T00:31:47.562Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f7944f1c-dbf3-46c3-a630-19b54f24b4c6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:47.960Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f7944f1c-dbf3-46c3-a630-19b54f24b4c6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=521 EndTimestamp=2021-07-13T00:31:47.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:47.439Z InvocationID=915da281-ae57-4214-b993-fc74c1c92694 ResponseDesc=OK 2021-07-13T00:31:48.070Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bedfe232-c7d7-49b5-a9ee-1a20df630437 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:48.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:48.069Z InvocationID=6cffa718-d599-45b7-b2a0-d3644af83733 2021-07-13T00:31:48.260Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bedfe232-c7d7-49b5-a9ee-1a20df630437 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:48.616Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bedfe232-c7d7-49b5-a9ee-1a20df630437 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=547 EndTimestamp=2021-07-13T00:31:48.616Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:48.069Z InvocationID=898e1efa-a493-4658-b57f-69ec1975167d ResponseDesc=OK 2021-07-13T00:31:48.873Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4982f36d-8ca2-46ab-8e10-04e839832209 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:48.873Z InvocationID=6a207c3f-4cec-4966-bd41-89c3502c84a8 2021-07-13T00:31:49.012Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4982f36d-8ca2-46ab-8e10-04e839832209 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:49.263Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4982f36d-8ca2-46ab-8e10-04e839832209 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=390 EndTimestamp=2021-07-13T00:31:49.263Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:48.873Z InvocationID=069d66cc-c0bf-45fb-bd25-877f8f6dced4 ResponseDesc=OK 2021-07-13T00:31:50.768Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a0d19e10-2fba-4d1f-9f4c-79c6068aa94f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:50.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:50.768Z InvocationID=faca0e34-a79e-4fa5-a803-28f86cb0fa62 2021-07-13T00:31:50.956Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a0d19e10-2fba-4d1f-9f4c-79c6068aa94f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:51.558Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a0d19e10-2fba-4d1f-9f4c-79c6068aa94f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=790 EndTimestamp=2021-07-13T00:31:51.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:50.768Z InvocationID=2f8ed865-b658-4e29-9aa8-ea7ecac71f4a ResponseDesc=OK 2021-07-13T00:31:53.663Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d3061d39-183f-49be-8510-49c6ba1e5c32 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:53.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:53.663Z InvocationID=5114a1df-1dbf-48bf-9d97-9ac336c43270 2021-07-13T00:31:53.828Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d3061d39-183f-49be-8510-49c6ba1e5c32 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:54.622Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d3061d39-183f-49be-8510-49c6ba1e5c32 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=958 EndTimestamp=2021-07-13T00:31:54.621Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:53.663Z InvocationID=2cb773b6-939f-42bf-a8ca-ef7a963d82b2 ResponseDesc=OK 2021-07-13T00:31:56.563Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=56a4b9e5-57b0-4b97-a6b1-36ff801217f1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:56.563Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:56.563Z InvocationID=8d6a6b0b-06e2-4f3b-9fac-53c45edba0c9 2021-07-13T00:31:56.670Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=56a4b9e5-57b0-4b97-a6b1-36ff801217f1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:57.060Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=56a4b9e5-57b0-4b97-a6b1-36ff801217f1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:31:57.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:56.563Z InvocationID=ed1840ca-edf3-4a17-9f18-3b1a906b57f5 ResponseDesc=OK 2021-07-13T00:31:57.439Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7120d51c-6532-4e93-aa0c-e343c4bf06eb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:57.439Z InvocationID=560ecaff-9c2c-4df8-bd00-d5323870d81f 2021-07-13T00:31:57.556Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7120d51c-6532-4e93-aa0c-e343c4bf06eb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:57.767Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7120d51c-6532-4e93-aa0c-e343c4bf06eb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=328 EndTimestamp=2021-07-13T00:31:57.767Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:57.439Z InvocationID=3072d299-91b2-4282-83c8-a4ab95a6ef1b ResponseDesc=OK 2021-07-13T00:31:58.873Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=75aa6a09-f93e-4cdf-9e78-c5cf3b9aeed4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:58.873Z InvocationID=30d4e382-a594-4970-b6ab-512f2e7fede0 2021-07-13T00:31:59.058Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=75aa6a09-f93e-4cdf-9e78-c5cf3b9aeed4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:31:59.312Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=75aa6a09-f93e-4cdf-9e78-c5cf3b9aeed4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:31:59.312Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:58.873Z InvocationID=5ac174cb-44a0-47dd-a141-ff319e47ed23 ResponseDesc=OK 2021-07-13T00:31:59.769Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ed5060da-5624-4898-a42a-26bb2bee4594 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:31:59.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:59.768Z InvocationID=e16371c8-9045-4b9a-9744-c18085103939 2021-07-13T00:31:59.915Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ed5060da-5624-4898-a42a-26bb2bee4594 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:00.660Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ed5060da-5624-4898-a42a-26bb2bee4594 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=892 EndTimestamp=2021-07-13T00:32:00.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:31:59.768Z InvocationID=ca9a16e4-8e17-479f-bea8-0dc1545e9c06 ResponseDesc=OK 2021-07-13T00:32:02.863Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=422c7a02-09cf-4733-8bec-29acf420a40a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:02.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:02.863Z InvocationID=d7d3ecd5-c534-4644-8bcf-5c77199fe08d 2021-07-13T00:32:02.957Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=422c7a02-09cf-4733-8bec-29acf420a40a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:03.357Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=422c7a02-09cf-4733-8bec-29acf420a40a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=494 EndTimestamp=2021-07-13T00:32:03.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:02.863Z InvocationID=4cd32838-13ec-459e-88bd-12c056f9f54e ResponseDesc=OK 2021-07-13T00:32:05.776Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=853a0863-e42c-41e5-a406-19b4685bd2d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:05.775Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:05.775Z InvocationID=2e531ae7-ea8c-46bf-a78c-5c8b2ec2378e 2021-07-13T00:32:07.440Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=498508f4-78c6-4ed5-8517-4108410fbcbe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:07.440Z InvocationID=dd5826e0-9822-4513-8d9c-ccd69710138a 2021-07-13T00:32:08.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4c882692-ff7e-4902-b7dd-02d7b5267f8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:08.874Z InvocationID=a016c500-75f3-4acb-8c69-051ad5e4d1ea 2021-07-13T00:32:09.739Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f00b82c7-bb7c-4f63-964c-8d3abcf61e59 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:09.739Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:09.739Z InvocationID=742cc8e3-7ced-46da-acfe-5aea4c4bf29d 2021-07-13T00:32:13.340Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=df430c75-32e7-4677-b89c-53dc18304764 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:13.340Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:13.340Z InvocationID=d30cbbf2-0296-4c6a-9aba-05034e836209 2021-07-13T00:32:15.787Z [qtp817348612-48] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=853a0863-e42c-41e5-a406-19b4685bd2d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:17.020Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9c7c0464-e2af-42da-97c3-6e9ebbcd6745 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:32:17.020Z ElapsedTime=0 EndTimestamp=2021-07-13T00:32:17.020Z InvocationID=c03e2a1e-0c1d-4bf1-b972-7c754bf83ffc PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:32:17.459Z [qtp817348612-56] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=498508f4-78c6-4ed5-8517-4108410fbcbe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:19.761Z [qtp817348612-65] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f00b82c7-bb7c-4f63-964c-8d3abcf61e59 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:20.886Z [qtp817348612-11] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4c882692-ff7e-4902-b7dd-02d7b5267f8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:32:21.002Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d98b115a-fa22-488e-9da1-1176d2508cf3 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:32:21.002Z ElapsedTime=0 EndTimestamp=2021-07-13T00:32:21.002Z InvocationID=0bdb5e31-20bb-4777-a381-0e7e73798765 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:32:22.440Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=33e1da08-15ac-459a-a6bc-3c1d60bda3f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:22.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:22.440Z InvocationID=a5f54ecb-6fb3-49b4-8081-6af462266d47 2021-07-13T00:32:23.359Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=df430c75-32e7-4677-b89c-53dc18304764 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:23.877Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=02351d45-9b22-4580-b694-79891cace08a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:23.877Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:23.877Z InvocationID=158e71c2-6dac-4559-95d9-1eee1e0eb8cf 2021-07-13T00:32:25.597Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=421681e8-cbc1-4c26-9123-015ffcf3ec52 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:32:25.597Z ElapsedTime=0 EndTimestamp=2021-07-13T00:32:25.597Z InvocationID=2c45758b-716a-4fdb-896a-62e1e49d2e33 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:32:27.061Z [qtp817348612-66] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9c7c0464-e2af-42da-97c3-6e9ebbcd6745 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:27.358Z [qtp817348612-66] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=9c7c0464-e2af-42da-97c3-6e9ebbcd6745 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:27.464Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=498508f4-78c6-4ed5-8517-4108410fbcbe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:27.470Z [qtp817348612-56] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=498508f4-78c6-4ed5-8517-4108410fbcbe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:27.470Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=498508f4-78c6-4ed5-8517-4108410fbcbe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:27.471Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=498508f4-78c6-4ed5-8517-4108410fbcbe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=20030 EndTimestamp=2021-07-13T00:32:27.470Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:07.440Z InvocationID=5391650f-b9b5-48e1-8b04-d9396cba9758 ResponseDesc=Internal Server Error 2021-07-13T00:32:27.885Z [qtp817348612-48] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=853a0863-e42c-41e5-a406-19b4685bd2d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:32:29.897Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0b98d196-b62b-4e75-a730-1530ca00d37c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:29.897Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:29.897Z InvocationID=f27b6b00-0cbd-45a5-a48b-d2a720f72c84 2021-07-13T00:32:30.468Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=33e1da08-15ac-459a-a6bc-3c1d60bda3f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:30.468Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=02351d45-9b22-4580-b694-79891cace08a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:30.857Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=02351d45-9b22-4580-b694-79891cace08a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=6980 EndTimestamp=2021-07-13T00:32:30.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:23.877Z InvocationID=5dff5611-59fe-4f21-bcc0-0fc37620e3da ResponseDesc=OK 2021-07-13T00:32:30.861Z [qtp817348612-68] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=224cd1ef-cfc9-4eca-be3a-1344efdaf2d2 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:32:30.861Z ElapsedTime=0 EndTimestamp=2021-07-13T00:32:30.861Z InvocationID=6fe87a2f-ce37-457a-b948-f47668895f30 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:32:30.890Z [qtp817348612-11] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=4c882692-ff7e-4902-b7dd-02d7b5267f8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:31.056Z [qtp817348612-68] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=224cd1ef-cfc9-4eca-be3a-1344efdaf2d2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:31.057Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=4c882692-ff7e-4902-b7dd-02d7b5267f8d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=22183 EndTimestamp=2021-07-13T00:32:31.057Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:08.874Z InvocationID=a64c62fa-bedc-4297-8a27-0399c60a0c05 ResponseDesc=Internal Server Error 2021-07-13T00:32:31.059Z [qtp817348612-67] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d98b115a-fa22-488e-9da1-1176d2508cf3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:31.118Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=421681e8-cbc1-4c26-9123-015ffcf3ec52 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:31.118Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0b98d196-b62b-4e75-a730-1530ca00d37c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:31.120Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=853a0863-e42c-41e5-a406-19b4685bd2d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=25345 EndTimestamp=2021-07-13T00:32:31.120Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:05.775Z InvocationID=7ba99550-3a3d-4180-959d-db661e2efb8e ResponseDesc=Internal Server Error 2021-07-13T00:32:31.123Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=9c7c0464-e2af-42da-97c3-6e9ebbcd6745 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=14103 EndTimestamp=2021-07-13T00:32:31.123Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:17.020Z InvocationID=a0425393-0765-4c83-a55c-bcf0d2fce68a ResponseDesc=Internal Server Error 2021-07-13T00:32:31.423Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f00b82c7-bb7c-4f63-964c-8d3abcf61e59 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=21684 EndTimestamp=2021-07-13T00:32:31.423Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:09.739Z InvocationID=b31e3a3d-e66b-4e28-9bc3-a42d45ef003b ResponseDesc=Internal Server Error 2021-07-13T00:32:33.362Z [qtp817348612-17] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=df430c75-32e7-4677-b89c-53dc18304764 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:32:35.052Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d98b115a-fa22-488e-9da1-1176d2508cf3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=14050 EndTimestamp=2021-07-13T00:32:35.052Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:21.002Z InvocationID=5790b206-9711-4e03-acaa-082e69934f02 ResponseDesc=Internal Server Error 2021-07-13T00:32:35.057Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0b98d196-b62b-4e75-a730-1530ca00d37c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5160 EndTimestamp=2021-07-13T00:32:35.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:29.897Z InvocationID=b310f457-cbb8-4edb-9f61-dc8d54c376a1 ResponseDesc=OK 2021-07-13T00:32:35.060Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=33e1da08-15ac-459a-a6bc-3c1d60bda3f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=12620 EndTimestamp=2021-07-13T00:32:35.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:22.440Z InvocationID=78109cc9-75c3-4beb-97b1-454c39ad3ae5 ResponseDesc=OK 2021-07-13T00:32:35.063Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=963cc38f-c018-43e0-a8bb-7fe3ef9c79de ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:32:35.063Z ElapsedTime=0 EndTimestamp=2021-07-13T00:32:35.063Z InvocationID=dbc2702e-28bf-435e-bf7a-a0fefeb3c7c3 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:32:35.161Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=421681e8-cbc1-4c26-9123-015ffcf3ec52 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=9564 EndTimestamp=2021-07-13T00:32:35.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:25.597Z InvocationID=6875d8db-c52b-427c-b001-67a9dac3ddbb ResponseDesc=OK 2021-07-13T00:32:35.163Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=963cc38f-c018-43e0-a8bb-7fe3ef9c79de InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:35.226Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=df430c75-32e7-4677-b89c-53dc18304764 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=21886 EndTimestamp=2021-07-13T00:32:35.226Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:13.340Z InvocationID=d3a1195b-e5d1-402f-8841-5b6d40b4ce24 ResponseDesc=Internal Server Error 2021-07-13T00:32:35.257Z [qtp817348612-68] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=224cd1ef-cfc9-4eca-be3a-1344efdaf2d2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4396 EndTimestamp=2021-07-13T00:32:35.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:30.861Z InvocationID=b50ea97d-2344-4535-9aab-1ce462b3f780 ResponseDesc=OK 2021-07-13T00:32:35.418Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=963cc38f-c018-43e0-a8bb-7fe3ef9c79de InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=355 EndTimestamp=2021-07-13T00:32:35.418Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:35.063Z InvocationID=d8847184-d5af-4195-aab6-079818347653 ResponseDesc=OK 2021-07-13T00:32:36.165Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=49ddabde-1faf-4fa2-8862-8153addc55ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:36.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:36.165Z InvocationID=aeaced96-fc83-433e-8591-1cdb0c7df2e6 2021-07-13T00:32:36.618Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=49ddabde-1faf-4fa2-8862-8153addc55ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:36.860Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=49ddabde-1faf-4fa2-8862-8153addc55ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=695 EndTimestamp=2021-07-13T00:32:36.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:36.165Z InvocationID=ba1fae59-42b1-4af5-8bd9-fd949e4002a8 ResponseDesc=OK 2021-07-13T00:32:37.439Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5f211a51-3345-4574-8893-e9ea9dd66962 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:37.439Z InvocationID=6cb46825-40fa-4360-a4fd-a43131da199d 2021-07-13T00:32:37.581Z [qtp817348612-66] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5f211a51-3345-4574-8893-e9ea9dd66962 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:38.557Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5f211a51-3345-4574-8893-e9ea9dd66962 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1118 EndTimestamp=2021-07-13T00:32:38.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:37.439Z InvocationID=d09ec2b0-3840-4fa2-8606-a9a2b1b0ed39 ResponseDesc=OK 2021-07-13T00:32:38.873Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=261da2a8-2831-4fd6-a4ef-2225467be2ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:38.873Z InvocationID=1db67729-d8c3-49af-8e24-83300cb60588 2021-07-13T00:32:38.960Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=261da2a8-2831-4fd6-a4ef-2225467be2ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:40.411Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=261da2a8-2831-4fd6-a4ef-2225467be2ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1538 EndTimestamp=2021-07-13T00:32:40.411Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:38.873Z InvocationID=7e0da84d-9c59-4d97-833d-b1aa72a22141 ResponseDesc=OK 2021-07-13T00:32:42.820Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=39896241-3b93-49e8-837c-ebed5aa06af8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:42.819Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:42.819Z InvocationID=c0ca4a0a-ff0e-4f5d-bd6d-bde4ae029275 2021-07-13T00:32:43.013Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=39896241-3b93-49e8-837c-ebed5aa06af8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:43.413Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=39896241-3b93-49e8-837c-ebed5aa06af8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=593 EndTimestamp=2021-07-13T00:32:43.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:42.819Z InvocationID=1446461d-67be-4130-be49-7f9aa414e252 ResponseDesc=OK 2021-07-13T00:32:44.271Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d556df0-2b3d-4307-b19b-b44cf90decbc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:44.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:44.271Z InvocationID=c8cd1273-7a44-42e7-afe5-b942c90ea93b 2021-07-13T00:32:44.461Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d556df0-2b3d-4307-b19b-b44cf90decbc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:44.758Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d556df0-2b3d-4307-b19b-b44cf90decbc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:32:44.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:44.271Z InvocationID=61c5ee23-b204-4f35-abc9-b265c16bd7f7 ResponseDesc=OK 2021-07-13T00:32:45.760Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cbdc4b62-794e-4862-be2d-dca402c33dfd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:45.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:45.760Z InvocationID=2048db2e-d297-4f07-9bd0-3ecce46973a3 2021-07-13T00:32:45.859Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cbdc4b62-794e-4862-be2d-dca402c33dfd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:46.215Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cbdc4b62-794e-4862-be2d-dca402c33dfd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=455 EndTimestamp=2021-07-13T00:32:46.215Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:45.760Z InvocationID=fa3f9818-b7d5-4f00-9ad9-2f236b9e1a4f ResponseDesc=OK 2021-07-13T00:32:47.359Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dedd81ed-5d0f-46e4-a701-1c2b8114a9c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:47.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:47.359Z InvocationID=1c3cfec0-af98-4a51-882d-e8f5010108e2 2021-07-13T00:32:47.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=909d519b-bafa-4ae6-9197-bcb356d9dbbb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:47.440Z InvocationID=516ae1a1-2f83-47b0-8e38-b86cc98f0bc2 2021-07-13T00:32:47.759Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=909d519b-bafa-4ae6-9197-bcb356d9dbbb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:47.772Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dedd81ed-5d0f-46e4-a701-1c2b8114a9c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:47.962Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=909d519b-bafa-4ae6-9197-bcb356d9dbbb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=522 EndTimestamp=2021-07-13T00:32:47.962Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:47.440Z InvocationID=c7431921-6100-479f-84a9-7084514c04bb ResponseDesc=OK 2021-07-13T00:32:48.158Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dedd81ed-5d0f-46e4-a701-1c2b8114a9c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=798 EndTimestamp=2021-07-13T00:32:48.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:47.359Z InvocationID=859d0e5b-3bbc-40f6-b386-36b9ccb933bc ResponseDesc=OK 2021-07-13T00:32:48.875Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=74c743c2-8f51-4111-b5a0-68c39865073b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:48.875Z InvocationID=f2ae3972-7ff7-4479-8fcc-b60aa89cc2ec 2021-07-13T00:32:49.059Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=74c743c2-8f51-4111-b5a0-68c39865073b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:49.369Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=379afb73-9e12-4d80-ab40-9a58af9aa0e0 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:32:49.368Z ElapsedTime=0 EndTimestamp=2021-07-13T00:32:49.368Z InvocationID=83013563-ca04-4855-813a-17e966467ecc PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:32:49.515Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=74c743c2-8f51-4111-b5a0-68c39865073b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=640 EndTimestamp=2021-07-13T00:32:49.515Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:48.875Z InvocationID=b2cc15c7-ce95-4525-9801-951563009b74 ResponseDesc=OK 2021-07-13T00:32:49.611Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=379afb73-9e12-4d80-ab40-9a58af9aa0e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:49.959Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=379afb73-9e12-4d80-ab40-9a58af9aa0e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=591 EndTimestamp=2021-07-13T00:32:49.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:49.368Z InvocationID=10b9dc2e-8eec-42c4-849c-3241a02fb4b7 ResponseDesc=OK 2021-07-13T00:32:51.062Z [qtp817348612-68] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5eecd3e7-bf70-4224-8390-83abc7aa27c2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:51.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:51.062Z InvocationID=65c2e3fa-a7bf-47ad-92c0-9434ecc0c682 2021-07-13T00:32:51.157Z [qtp817348612-68] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5eecd3e7-bf70-4224-8390-83abc7aa27c2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:51.557Z [qtp817348612-68] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5eecd3e7-bf70-4224-8390-83abc7aa27c2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:32:51.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:51.062Z InvocationID=3411a198-f76c-4c4e-879f-4bfb4d99f9af ResponseDesc=OK 2021-07-13T00:32:52.572Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=35bfca0b-8d48-4b60-9734-4c79cdf07133 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:52.572Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:52.572Z InvocationID=93fb1c05-0d56-4487-bac9-a674b912f663 2021-07-13T00:32:52.668Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=35bfca0b-8d48-4b60-9734-4c79cdf07133 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:53.035Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=35bfca0b-8d48-4b60-9734-4c79cdf07133 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=463 EndTimestamp=2021-07-13T00:32:53.035Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:52.572Z InvocationID=5d6ecae3-72f1-4653-93d2-f219bd3feed3 ResponseDesc=OK 2021-07-13T00:32:54.064Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dd6095a2-5843-4654-825e-471a2557b924 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:54.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:54.064Z InvocationID=d415d659-a63f-4e2e-a2df-3afea3d91e5e 2021-07-13T00:32:54.213Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dd6095a2-5843-4654-825e-471a2557b924 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:54.460Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dd6095a2-5843-4654-825e-471a2557b924 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=395 EndTimestamp=2021-07-13T00:32:54.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:54.064Z InvocationID=2c4affc4-e4cb-43fc-aba8-40681aa25a65 ResponseDesc=OK 2021-07-13T00:32:55.464Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9d2f5b7-3d4f-45a2-9f0c-301117f4fb5e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:55.464Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:55.464Z InvocationID=b203e803-88f8-41cf-aaff-9cdc5ab65ee5 2021-07-13T00:32:55.656Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b9d2f5b7-3d4f-45a2-9f0c-301117f4fb5e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:56.157Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b9d2f5b7-3d4f-45a2-9f0c-301117f4fb5e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=693 EndTimestamp=2021-07-13T00:32:56.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:55.464Z InvocationID=2e87b71c-618a-4428-b4c6-747bfb8027e3 ResponseDesc=OK 2021-07-13T00:32:57.261Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce2e58a3-3e49-4624-a4d9-2f57ce80ace8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:57.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:57.261Z InvocationID=ff06f50b-fba6-42e0-979e-ec51064ef443 2021-07-13T00:32:57.359Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce2e58a3-3e49-4624-a4d9-2f57ce80ace8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:57.443Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1b9853f4-ab82-455e-8ea0-86a8b986ee08 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:57.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:57.443Z InvocationID=c3aa39cf-ab93-44f5-9d0a-ae85ed30b0bd 2021-07-13T00:32:57.715Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1b9853f4-ab82-455e-8ea0-86a8b986ee08 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:57.716Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ce2e58a3-3e49-4624-a4d9-2f57ce80ace8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=455 EndTimestamp=2021-07-13T00:32:57.716Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:57.261Z InvocationID=faa70da7-98a3-40be-9148-a91e50dddf5b ResponseDesc=OK 2021-07-13T00:32:57.959Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1b9853f4-ab82-455e-8ea0-86a8b986ee08 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=516 EndTimestamp=2021-07-13T00:32:57.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:57.443Z InvocationID=21944b96-3638-4628-a253-10bd7a792253 ResponseDesc=OK 2021-07-13T00:32:58.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8c20dd6f-aafb-4d4e-8b04-1927c7b544e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:32:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:58.873Z InvocationID=22f7ae38-cc29-4d46-b9ee-9f809cb395e9 2021-07-13T00:32:59.057Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8c20dd6f-aafb-4d4e-8b04-1927c7b544e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:32:59.458Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8c20dd6f-aafb-4d4e-8b04-1927c7b544e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=584 EndTimestamp=2021-07-13T00:32:59.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:32:58.873Z InvocationID=9ad81e95-5a03-467d-a439-6901eea41b61 ResponseDesc=OK 2021-07-13T00:33:00.075Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d6da51d8-2334-4333-9217-adcbe42fdebb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:00.075Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:00.075Z InvocationID=7cc1ded4-6d19-4869-be46-4ec742cc170f 2021-07-13T00:33:00.259Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d6da51d8-2334-4333-9217-adcbe42fdebb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:00.611Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d6da51d8-2334-4333-9217-adcbe42fdebb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=536 EndTimestamp=2021-07-13T00:33:00.611Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:00.075Z InvocationID=81e783bd-55d9-484a-9fcf-b90172852916 ResponseDesc=OK 2021-07-13T00:33:02.875Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bd17f816-1e37-4f29-ace4-3ef0a4f4e242 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:02.874Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:02.874Z InvocationID=3ece775c-8acb-4376-bc79-e22062eed1ab 2021-07-13T00:33:03.522Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bd17f816-1e37-4f29-ace4-3ef0a4f4e242 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:03.859Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bd17f816-1e37-4f29-ace4-3ef0a4f4e242 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=985 EndTimestamp=2021-07-13T00:33:03.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:02.874Z InvocationID=92668181-5bab-41d8-b77f-754b252260e0 ResponseDesc=OK 2021-07-13T00:33:05.963Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=010923d8-39b7-4a72-8779-25d502641362 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:05.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:05.963Z InvocationID=b57a259d-dce9-466d-a9ee-449b43f321b1 2021-07-13T00:33:06.057Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=010923d8-39b7-4a72-8779-25d502641362 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:06.668Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=010923d8-39b7-4a72-8779-25d502641362 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=705 EndTimestamp=2021-07-13T00:33:06.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:05.963Z InvocationID=d7ef10bb-3da9-4374-978e-06e191f25523 ResponseDesc=OK 2021-07-13T00:33:07.440Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=67e022e5-73ff-4db2-a209-02fd0a73fcd7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:07.440Z InvocationID=3c57dff2-6c60-41dc-b652-7b08959fa595 2021-07-13T00:33:07.516Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=67e022e5-73ff-4db2-a209-02fd0a73fcd7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:07.924Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=67e022e5-73ff-4db2-a209-02fd0a73fcd7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=484 EndTimestamp=2021-07-13T00:33:07.924Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:07.440Z InvocationID=1dfdcadb-1028-49c7-baec-f2ae1fe91820 ResponseDesc=OK 2021-07-13T00:33:08.873Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4f27ad0e-1c90-461a-8620-883e963cb462 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:08.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:08.873Z InvocationID=1e535e7e-2f6b-4c1a-8916-3564a7ca4353 2021-07-13T00:33:08.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7193df7b-e948-4413-b9c5-a3412b474c63 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:08.873Z InvocationID=85b59390-c6fb-4b82-83de-c2b8ac7342c5 2021-07-13T00:33:08.970Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4f27ad0e-1c90-461a-8620-883e963cb462 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:09.027Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7193df7b-e948-4413-b9c5-a3412b474c63 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:10.161Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4f27ad0e-1c90-461a-8620-883e963cb462 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1287 EndTimestamp=2021-07-13T00:33:10.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:08.873Z InvocationID=7f694bb0-e429-4036-a29e-27b59d713754 ResponseDesc=OK 2021-07-13T00:33:10.258Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7193df7b-e948-4413-b9c5-a3412b474c63 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1384 EndTimestamp=2021-07-13T00:33:10.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:08.873Z InvocationID=08936cdb-c40f-422d-bb3a-6f84cfd7747e ResponseDesc=OK 2021-07-13T00:33:11.668Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a4680a04-f873-435f-962c-aa369274e60e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:11.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:11.668Z InvocationID=af06d102-572b-4481-8462-afdb0c1047b4 2021-07-13T00:33:11.759Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a4680a04-f873-435f-962c-aa369274e60e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:12.013Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a4680a04-f873-435f-962c-aa369274e60e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=345 EndTimestamp=2021-07-13T00:33:12.013Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:11.668Z InvocationID=01a65507-2e55-4253-830c-dd9f6c34f462 ResponseDesc=OK 2021-07-13T00:33:15.320Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fe359fa9-badb-49e8-97e6-1a84d50d8ce7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:15.319Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:15.319Z InvocationID=d3fe0d06-94c7-4077-b7a6-e9b86c05e646 2021-07-13T00:33:15.514Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fe359fa9-badb-49e8-97e6-1a84d50d8ce7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:15.963Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fe359fa9-badb-49e8-97e6-1a84d50d8ce7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=644 EndTimestamp=2021-07-13T00:33:15.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:15.319Z InvocationID=5d8ee942-dfa0-4816-8970-c1736c178eb8 ResponseDesc=OK 2021-07-13T00:33:17.441Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d41bf4c4-0d03-408f-9944-9a317385cdb2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:17.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:17.441Z InvocationID=04b554a4-69ca-4cbc-a2d8-94d1a201d9d7 2021-07-13T00:33:17.557Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d41bf4c4-0d03-408f-9944-9a317385cdb2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:18.257Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d41bf4c4-0d03-408f-9944-9a317385cdb2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=815 EndTimestamp=2021-07-13T00:33:18.256Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:17.441Z InvocationID=824ffd73-e8b5-487b-9220-08ea1acc21de ResponseDesc=OK 2021-07-13T00:33:18.477Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c008f9a5-a97e-45ed-a338-b18f7d9b51b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:18.477Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:18.477Z InvocationID=40817e46-6fa3-41e7-b942-9050afb221ca 2021-07-13T00:33:18.658Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c008f9a5-a97e-45ed-a338-b18f7d9b51b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:18.874Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31ff31a7-b9bf-4a82-9756-3b9f2cda3cac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:18.874Z InvocationID=29f0a27c-fe1f-4f41-9b77-34b1f987be29 2021-07-13T00:33:19.331Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c008f9a5-a97e-45ed-a338-b18f7d9b51b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=854 EndTimestamp=2021-07-13T00:33:19.331Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:18.477Z InvocationID=c7e25f1f-e9b9-4a11-8bd6-3e81a787f0a4 ResponseDesc=OK 2021-07-13T00:33:19.346Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31ff31a7-b9bf-4a82-9756-3b9f2cda3cac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:19.563Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31ff31a7-b9bf-4a82-9756-3b9f2cda3cac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=689 EndTimestamp=2021-07-13T00:33:19.563Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:18.874Z InvocationID=7dbfd02e-eb72-44a9-b3f1-7a6111c8cd5f ResponseDesc=OK 2021-07-13T00:33:20.769Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=93b648fe-eff9-451e-a724-b6ff38219aa8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:20.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:20.769Z InvocationID=b826bff6-9a21-4d5f-b8ff-850285d0c8ca 2021-07-13T00:33:20.859Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=93b648fe-eff9-451e-a724-b6ff38219aa8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:21.158Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=93b648fe-eff9-451e-a724-b6ff38219aa8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=389 EndTimestamp=2021-07-13T00:33:21.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:20.769Z InvocationID=3eba0754-18d6-4f75-a6d8-8f64600d3773 ResponseDesc=OK 2021-07-13T00:33:23.679Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9da36d6b-3bde-4398-9cb6-d80c2dcabee3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:23.679Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:23.679Z InvocationID=b5c96e6a-a1fc-43c0-85c3-ae5e919d53f3 2021-07-13T00:33:23.765Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9da36d6b-3bde-4398-9cb6-d80c2dcabee3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:24.120Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9da36d6b-3bde-4398-9cb6-d80c2dcabee3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=441 EndTimestamp=2021-07-13T00:33:24.120Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:23.679Z InvocationID=12b06946-2b5a-4db9-b916-ff39616f3896 ResponseDesc=OK 2021-07-13T00:33:26.947Z [qtp817348612-68] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=beab8f96-8d1b-40f3-ad28-b10a8ba9b7e1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:26.947Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:26.947Z InvocationID=56ba2870-51f7-43cf-b858-49aaffa32117 2021-07-13T00:33:27.440Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=44d88bf7-a054-4109-8eec-75c41dc0f92f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:27.440Z InvocationID=597629c0-0ec2-425a-a464-56d20785f2a6 2021-07-13T00:33:27.625Z [qtp817348612-68] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=beab8f96-8d1b-40f3-ad28-b10a8ba9b7e1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:27.658Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=44d88bf7-a054-4109-8eec-75c41dc0f92f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:27.859Z [qtp817348612-68] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=beab8f96-8d1b-40f3-ad28-b10a8ba9b7e1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=912 EndTimestamp=2021-07-13T00:33:27.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:26.947Z InvocationID=4663c77c-265e-4386-9dda-335c5aa9972a ResponseDesc=OK 2021-07-13T00:33:28.060Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=44d88bf7-a054-4109-8eec-75c41dc0f92f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=620 EndTimestamp=2021-07-13T00:33:28.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:27.440Z InvocationID=dfbf9241-ec19-4902-937c-a5a81a03d078 ResponseDesc=OK 2021-07-13T00:33:28.873Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ece880f9-8119-4166-89c3-b4434b727845 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:28.873Z InvocationID=156aedca-2a3a-49fd-b4ef-125724d9cf4f 2021-07-13T00:33:29.058Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ece880f9-8119-4166-89c3-b4434b727845 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:29.431Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ece880f9-8119-4166-89c3-b4434b727845 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=557 EndTimestamp=2021-07-13T00:33:29.430Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:28.873Z InvocationID=cd3612ba-c5c9-464a-8ae9-90f184d50b04 ResponseDesc=OK 2021-07-13T00:33:29.972Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=72c13828-04bb-4bba-9be2-156ad7e5ba90 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:29.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:29.972Z InvocationID=bbf2a5b9-befb-41d0-b868-db6660cacf41 2021-07-13T00:33:30.663Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=72c13828-04bb-4bba-9be2-156ad7e5ba90 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:30.960Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=72c13828-04bb-4bba-9be2-156ad7e5ba90 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=987 EndTimestamp=2021-07-13T00:33:30.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:29.972Z InvocationID=b5d09450-cc08-44a0-8868-f7505cedd1ae ResponseDesc=OK 2021-07-13T00:33:32.814Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1baf2368-4f4b-4510-b242-d8a25e06d496 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:32.814Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:32.814Z InvocationID=514672e2-1893-48a0-838e-2fe2ddc44be7 2021-07-13T00:33:32.875Z [qtp817348612-66] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1baf2368-4f4b-4510-b242-d8a25e06d496 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:33.457Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1baf2368-4f4b-4510-b242-d8a25e06d496 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=643 EndTimestamp=2021-07-13T00:33:33.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:32.814Z InvocationID=eb2b3cc3-937d-4f05-9bb9-abe836cbd110 ResponseDesc=OK 2021-07-13T00:33:35.765Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4be2e0e6-6906-490a-80d1-c29b948db082 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:35.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:35.765Z InvocationID=40426798-0773-4462-a12e-fb47b0df4d50 2021-07-13T00:33:35.859Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4be2e0e6-6906-490a-80d1-c29b948db082 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:36.223Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4be2e0e6-6906-490a-80d1-c29b948db082 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=458 EndTimestamp=2021-07-13T00:33:36.223Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:35.765Z InvocationID=69fb845d-c1e1-4ab5-84ec-0cfe96389a9c ResponseDesc=OK 2021-07-13T00:33:37.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a0dc04b8-d054-408b-96c7-d8c4de019bf8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:37.439Z InvocationID=2b3c24f7-798c-4db5-8484-dd447110aea8 2021-07-13T00:33:37.618Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a0dc04b8-d054-408b-96c7-d8c4de019bf8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:37.860Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a0dc04b8-d054-408b-96c7-d8c4de019bf8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=420 EndTimestamp=2021-07-13T00:33:37.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:37.439Z InvocationID=59ea9cce-8d9b-42f8-a596-eb7c4137fc5b ResponseDesc=OK 2021-07-13T00:33:38.466Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c1a3ca06-40b5-411f-ab2b-67b33b41c0ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:38.466Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:38.466Z InvocationID=b028e9b5-bd15-400f-b161-173b791b9d41 2021-07-13T00:33:38.656Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c1a3ca06-40b5-411f-ab2b-67b33b41c0ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:38.866Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c1a3ca06-40b5-411f-ab2b-67b33b41c0ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=400 EndTimestamp=2021-07-13T00:33:38.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:38.466Z InvocationID=72068e4d-b091-40e7-9b90-b361ef955fd0 ResponseDesc=OK 2021-07-13T00:33:38.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=108b0d92-ccc6-49ae-b82f-8da2737abe46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:38.873Z InvocationID=fa1e03f9-a1e8-4f70-adb9-4b1222c67e25 2021-07-13T00:33:38.959Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=108b0d92-ccc6-49ae-b82f-8da2737abe46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:39.162Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=108b0d92-ccc6-49ae-b82f-8da2737abe46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=289 EndTimestamp=2021-07-13T00:33:39.162Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:38.873Z InvocationID=a1cd910e-90d3-4fc0-ae82-d738f1b83473 ResponseDesc=OK 2021-07-13T00:33:42.072Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f0c90b0d-1920-4123-8da6-05ca17c40fc6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:42.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:42.072Z InvocationID=5cdf0ec7-dc86-47ca-8058-02f422899046 2021-07-13T00:33:42.318Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f0c90b0d-1920-4123-8da6-05ca17c40fc6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:42.559Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f0c90b0d-1920-4123-8da6-05ca17c40fc6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=487 EndTimestamp=2021-07-13T00:33:42.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:42.072Z InvocationID=b2e8c745-0022-436b-beb1-0e5b3700103a ResponseDesc=OK 2021-07-13T00:33:44.962Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e6ad1dc8-62df-4a77-98c8-6e87780857e6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:44.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:44.962Z InvocationID=887a74b4-d8c3-4611-802d-6e9634468a60 2021-07-13T00:33:45.256Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e6ad1dc8-62df-4a77-98c8-6e87780857e6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:45.557Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e6ad1dc8-62df-4a77-98c8-6e87780857e6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=595 EndTimestamp=2021-07-13T00:33:45.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:44.962Z InvocationID=63b6225d-341b-4036-8ba6-947a4b6beca4 ResponseDesc=OK 2021-07-13T00:33:47.441Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=59379c4d-a32f-4a46-9166-75a2e2293a67 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:47.440Z InvocationID=6517334a-c272-4a76-9e3a-077992375bab 2021-07-13T00:33:47.559Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=59379c4d-a32f-4a46-9166-75a2e2293a67 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:47.825Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=59379c4d-a32f-4a46-9166-75a2e2293a67 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=385 EndTimestamp=2021-07-13T00:33:47.825Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:47.440Z InvocationID=5a72bd5d-4484-4a1d-a74b-5e5bbe8d9c29 ResponseDesc=OK 2021-07-13T00:33:47.965Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d5b5665-f246-49ec-8566-52fc4167c778 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:47.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:47.965Z InvocationID=216820cc-f0ed-4ee0-a4a2-9e7dad7e4d88 2021-07-13T00:33:48.611Z [qtp817348612-66] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d5b5665-f246-49ec-8566-52fc4167c778 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:48.860Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d5b5665-f246-49ec-8566-52fc4167c778 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=894 EndTimestamp=2021-07-13T00:33:48.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:47.965Z InvocationID=d348a50d-b892-42fa-a320-e0f26b521546 ResponseDesc=OK 2021-07-13T00:33:48.874Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a05457ce-bdc4-4ec9-91e2-b01b193fd715 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:48.874Z InvocationID=55927196-8447-4430-b0e6-e95918380547 2021-07-13T00:33:49.057Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a05457ce-bdc4-4ec9-91e2-b01b193fd715 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:50.159Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a05457ce-bdc4-4ec9-91e2-b01b193fd715 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1284 EndTimestamp=2021-07-13T00:33:50.158Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:48.874Z InvocationID=67bcb990-de8d-4b66-8b6c-a71a48d3b7c8 ResponseDesc=OK 2021-07-13T00:33:51.160Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d0ecb23c-c726-4456-8068-81be6a958834 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:51.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:51.160Z InvocationID=b4d55108-5af5-4b8b-a2b5-eb7f9cfad7c8 2021-07-13T00:33:51.259Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d0ecb23c-c726-4456-8068-81be6a958834 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:52.571Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d0ecb23c-c726-4456-8068-81be6a958834 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1411 EndTimestamp=2021-07-13T00:33:52.571Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:51.160Z InvocationID=3537295a-1235-44d8-9636-5363322aca8e ResponseDesc=OK 2021-07-13T00:33:53.662Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5351e239-887c-4c30-9558-4e19facc04e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:53.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:53.662Z InvocationID=e2320f5a-c590-4aa3-9082-204fadb665ef 2021-07-13T00:33:54.166Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5351e239-887c-4c30-9558-4e19facc04e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:54.312Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5351e239-887c-4c30-9558-4e19facc04e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=650 EndTimestamp=2021-07-13T00:33:54.312Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:53.662Z InvocationID=02cd9a43-132a-42d8-989e-162673980c4b ResponseDesc=OK 2021-07-13T00:33:56.873Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=894e00f9-01b1-4aa8-a104-ddbd0cb5aa31 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:56.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:56.873Z InvocationID=4dedc761-b60f-4b17-ada0-37a1bb5cbe12 2021-07-13T00:33:57.257Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=894e00f9-01b1-4aa8-a104-ddbd0cb5aa31 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:57.440Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=308938f0-3734-4309-9ae4-581d7d60313c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:57.440Z InvocationID=0640d23e-0b07-4085-9683-a2ae998a9f78 2021-07-13T00:33:57.469Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=894e00f9-01b1-4aa8-a104-ddbd0cb5aa31 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=596 EndTimestamp=2021-07-13T00:33:57.469Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:56.873Z InvocationID=81f468b7-efd4-40bf-8ec2-a4cff041be69 ResponseDesc=OK 2021-07-13T00:33:57.471Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=308938f0-3734-4309-9ae4-581d7d60313c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:57.764Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=308938f0-3734-4309-9ae4-581d7d60313c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=324 EndTimestamp=2021-07-13T00:33:57.764Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:57.440Z InvocationID=d0a82cb6-ef89-4a74-a9a1-ce71374b9f51 ResponseDesc=OK 2021-07-13T00:33:58.874Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c9dd4615-b80f-4dcd-8034-c69ef5dcfc0b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:33:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:58.874Z InvocationID=04ed2a9a-a04a-4641-8cdb-7d9763512dfc 2021-07-13T00:33:59.114Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c9dd4615-b80f-4dcd-8034-c69ef5dcfc0b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:33:59.364Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c9dd4615-b80f-4dcd-8034-c69ef5dcfc0b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=490 EndTimestamp=2021-07-13T00:33:59.364Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:33:58.874Z InvocationID=a5239f28-d368-4e3c-a815-91d551f3b23a ResponseDesc=OK 2021-07-13T00:34:00.065Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0bf11966-2f7a-498c-bcc5-af3c0fca44d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:00.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:00.065Z InvocationID=6d00e9f7-3971-4675-b77f-5a7737d38872 2021-07-13T00:34:00.157Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0bf11966-2f7a-498c-bcc5-af3c0fca44d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:00.558Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0bf11966-2f7a-498c-bcc5-af3c0fca44d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=493 EndTimestamp=2021-07-13T00:34:00.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:00.065Z InvocationID=8154d4a5-9bfc-4ffd-82fb-87b4de4f9ed0 ResponseDesc=OK 2021-07-13T00:34:02.980Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3ec42ed8-6025-42bb-b7f6-880a9ba84b68 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:02.980Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:02.980Z InvocationID=9b1fc4fb-c02e-454f-baa9-e96c28340c2d 2021-07-13T00:34:03.159Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3ec42ed8-6025-42bb-b7f6-880a9ba84b68 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:03.359Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3ec42ed8-6025-42bb-b7f6-880a9ba84b68 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=379 EndTimestamp=2021-07-13T00:34:03.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:02.980Z InvocationID=29069434-7395-4649-8ad9-99aac67d5b0c ResponseDesc=OK 2021-07-13T00:34:05.574Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=73036e68-7008-4603-a84e-b199a7268535 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:05.574Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:05.574Z InvocationID=0e6e0189-b7f3-446a-8e4e-7bfd1611cfd6 2021-07-13T00:34:05.662Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=73036e68-7008-4603-a84e-b199a7268535 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:05.766Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=73036e68-7008-4603-a84e-b199a7268535 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=192 EndTimestamp=2021-07-13T00:34:05.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:05.574Z InvocationID=42b7e08a-6aa9-4d5d-9018-c721d1c87bcc ResponseDesc=OK 2021-07-13T00:34:07.439Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=49d14a4c-d8ee-47c3-baa8-e5dafdd24940 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:07.439Z InvocationID=c56b3853-b0b0-41c8-b622-de736cba25f5 2021-07-13T00:34:07.556Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=49d14a4c-d8ee-47c3-baa8-e5dafdd24940 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:08.463Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=49d14a4c-d8ee-47c3-baa8-e5dafdd24940 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1024 EndTimestamp=2021-07-13T00:34:08.463Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:07.439Z InvocationID=3673e1d4-d572-4fa4-9ad2-e5f3b2867a27 ResponseDesc=OK 2021-07-13T00:34:08.761Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6ed4fbbe-3b47-4606-948e-490fc9e6ed51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:08.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:08.761Z InvocationID=9eed8784-cba1-445c-af34-e14de105895d 2021-07-13T00:34:08.857Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6ed4fbbe-3b47-4606-948e-490fc9e6ed51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:08.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0d609db0-00b7-490b-a253-bda03d524a7b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:08.874Z InvocationID=b1ca565d-8964-4dc5-b0f8-f6cd0e14dbba 2021-07-13T00:34:08.875Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6ed4fbbe-3b47-4606-948e-490fc9e6ed51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=114 EndTimestamp=2021-07-13T00:34:08.875Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:08.761Z InvocationID=d5c6fc1e-b6db-4576-87d3-aae34d7161f3 ResponseDesc=OK 2021-07-13T00:34:09.178Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0d609db0-00b7-490b-a253-bda03d524a7b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:09.266Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0d609db0-00b7-490b-a253-bda03d524a7b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=392 EndTimestamp=2021-07-13T00:34:09.266Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:08.874Z InvocationID=90aa038a-4df7-4745-9eb7-d0ac61277264 ResponseDesc=OK 2021-07-13T00:34:11.960Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be00d400-c326-4aac-bf66-aec781f16887 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:11.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:11.960Z InvocationID=136d8316-4d4c-4a62-be1f-80d94281147d 2021-07-13T00:34:11.967Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be00d400-c326-4aac-bf66-aec781f16887 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:12.157Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be00d400-c326-4aac-bf66-aec781f16887 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=197 EndTimestamp=2021-07-13T00:34:12.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:11.960Z InvocationID=772be2af-1d3a-46fc-90ff-4dadd91595b2 ResponseDesc=OK 2021-07-13T00:34:15.470Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=38a20542-65a0-4744-87ef-bd2c906223c0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:15.470Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:15.470Z InvocationID=a8940315-0e03-446e-9cca-f03044d5c094 2021-07-13T00:34:15.559Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=38a20542-65a0-4744-87ef-bd2c906223c0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:15.839Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=38a20542-65a0-4744-87ef-bd2c906223c0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=369 EndTimestamp=2021-07-13T00:34:15.839Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:15.470Z InvocationID=c931a75d-d0cf-440e-84df-10b0d3c9fd69 ResponseDesc=OK 2021-07-13T00:34:17.439Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e644da8-ff6e-4874-9f66-3e024af927d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:17.439Z InvocationID=707f83ea-a76c-4bff-9857-9b381d2ffdc4 2021-07-13T00:34:17.463Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=853d4634-2668-42f8-bb8a-a354b6920ee2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:17.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:17.462Z InvocationID=867e7d64-3b00-4d26-8779-a84b3306d032 2021-07-13T00:34:17.464Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e644da8-ff6e-4874-9f66-3e024af927d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:17.468Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=853d4634-2668-42f8-bb8a-a354b6920ee2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:17.657Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e644da8-ff6e-4874-9f66-3e024af927d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=218 EndTimestamp=2021-07-13T00:34:17.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:17.439Z InvocationID=34d39b45-8424-48b8-a1b9-acf21fac9bac ResponseDesc=OK 2021-07-13T00:34:17.659Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=853d4634-2668-42f8-bb8a-a354b6920ee2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=197 EndTimestamp=2021-07-13T00:34:17.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:17.462Z InvocationID=796660e3-baab-4296-b887-6c18deebaa0a ResponseDesc=OK 2021-07-13T00:34:18.874Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dbed8dba-1fa0-44eb-ba6c-3fe98b278a45 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:18.874Z InvocationID=ab05c8b6-0b34-4f25-8559-7b86c5995040 2021-07-13T00:34:19.159Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dbed8dba-1fa0-44eb-ba6c-3fe98b278a45 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:20.168Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dbed8dba-1fa0-44eb-ba6c-3fe98b278a45 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1294 EndTimestamp=2021-07-13T00:34:20.168Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:18.874Z InvocationID=9622a39b-2e02-467e-8deb-44c7170714e8 ResponseDesc=OK 2021-07-13T00:34:20.865Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=32ece21a-ea60-499d-8284-83f7ef7e8692 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:20.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:20.865Z InvocationID=b765b805-f691-45a2-9bc7-4f71c6c21b16 2021-07-13T00:34:21.087Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=32ece21a-ea60-499d-8284-83f7ef7e8692 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:21.267Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=32ece21a-ea60-499d-8284-83f7ef7e8692 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=402 EndTimestamp=2021-07-13T00:34:21.267Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:20.865Z InvocationID=7591db63-9aea-4d58-97eb-dc38db34bf86 ResponseDesc=OK 2021-07-13T00:34:23.763Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=24bc7841-ceb9-4bdc-b582-103ec92b9f61 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:23.762Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:23.762Z InvocationID=2f2cfca4-a6ca-40ca-9f08-8f5cb5e08ef1 2021-07-13T00:34:23.857Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=24bc7841-ceb9-4bdc-b582-103ec92b9f61 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:23.972Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=24bc7841-ceb9-4bdc-b582-103ec92b9f61 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=210 EndTimestamp=2021-07-13T00:34:23.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:23.762Z InvocationID=64c681f8-308b-48e5-95c0-6cb67baef99c ResponseDesc=OK 2021-07-13T00:34:26.874Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e74660c5-da5e-4d2f-b4b4-28c9ef93941e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:26.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:26.873Z InvocationID=e6e8ecc8-6ec2-4ea8-9181-fc041b1acdff 2021-07-13T00:34:27.011Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e74660c5-da5e-4d2f-b4b4-28c9ef93941e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:27.420Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e74660c5-da5e-4d2f-b4b4-28c9ef93941e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=546 EndTimestamp=2021-07-13T00:34:27.419Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:26.873Z InvocationID=cc3542d5-a25c-4984-acf2-6392634ac698 ResponseDesc=OK 2021-07-13T00:34:27.441Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c135ac03-56de-4c4b-9a38-6933fb56264e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:27.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:27.441Z InvocationID=cebadaa1-2e45-43f2-aab5-b521214f9512 2021-07-13T00:34:28.328Z [qtp817348612-20] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c135ac03-56de-4c4b-9a38-6933fb56264e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:28.761Z [qtp817348612-20] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c135ac03-56de-4c4b-9a38-6933fb56264e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1320 EndTimestamp=2021-07-13T00:34:28.761Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:27.441Z InvocationID=2aeadaf2-03ed-4ceb-83d4-f0c7bc9984e0 ResponseDesc=OK 2021-07-13T00:34:28.876Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e46203a4-6513-4acf-bcbb-31e8ac6f9128 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:28.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:28.876Z InvocationID=c0ca5cb2-42b2-4ba3-8ffb-cb006e26b8c3 2021-07-13T00:34:29.057Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e46203a4-6513-4acf-bcbb-31e8ac6f9128 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:29.461Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e46203a4-6513-4acf-bcbb-31e8ac6f9128 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=585 EndTimestamp=2021-07-13T00:34:29.461Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:28.876Z InvocationID=1f127f87-0545-4930-8100-d6bc4a67800b ResponseDesc=OK 2021-07-13T00:34:29.962Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=26b30242-0181-4034-bc1f-5adf22916ed9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:29.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:29.961Z InvocationID=fd176ac7-78ce-4805-a75f-0050ba514b61 2021-07-13T00:34:30.061Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=26b30242-0181-4034-bc1f-5adf22916ed9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:30.316Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=26b30242-0181-4034-bc1f-5adf22916ed9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=355 EndTimestamp=2021-07-13T00:34:30.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:29.961Z InvocationID=f571030c-07cf-4872-b25c-1c8dce0a36cc ResponseDesc=OK 2021-07-13T00:34:32.677Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b6e8c5d7-2906-424b-970f-f9ddda6a88b4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:32.677Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:32.677Z InvocationID=66ad5ae3-d5bc-46bd-92ca-9ecabe1172e3 2021-07-13T00:34:32.871Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b6e8c5d7-2906-424b-970f-f9ddda6a88b4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:32.974Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b6e8c5d7-2906-424b-970f-f9ddda6a88b4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=296 EndTimestamp=2021-07-13T00:34:32.973Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:32.677Z InvocationID=95e80b4e-77d0-48be-aeef-cda08c585ace ResponseDesc=OK 2021-07-13T00:34:35.968Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dad5d9c7-ba51-443d-9b6f-fb125a3ea05b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:35.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:35.968Z InvocationID=5806d1bd-9e9c-41da-9c0b-6857af8977a7 2021-07-13T00:34:36.356Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dad5d9c7-ba51-443d-9b6f-fb125a3ea05b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:36.669Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dad5d9c7-ba51-443d-9b6f-fb125a3ea05b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=701 EndTimestamp=2021-07-13T00:34:36.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:35.968Z InvocationID=70d5eb58-9390-4b79-93be-12b7bee2b9b3 ResponseDesc=OK 2021-07-13T00:34:37.440Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=41cb80f4-8f03-43b4-a056-f2dc5ae3ed34 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:37.440Z InvocationID=d32d547c-eaf6-44b9-b795-3c707d2a09ac 2021-07-13T00:34:37.464Z [qtp817348612-66] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=41cb80f4-8f03-43b4-a056-f2dc5ae3ed34 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:37.612Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=41cb80f4-8f03-43b4-a056-f2dc5ae3ed34 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=172 EndTimestamp=2021-07-13T00:34:37.612Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:37.440Z InvocationID=5f609cc9-f231-4fb2-a914-ebd28ce959b2 ResponseDesc=OK 2021-07-13T00:34:38.463Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=76edf278-c344-4684-90d9-eaea1ee764b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:38.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:38.463Z InvocationID=b30b5386-ff40-4665-9b0c-98b71c09a0b7 2021-07-13T00:34:38.611Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=76edf278-c344-4684-90d9-eaea1ee764b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:38.876Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b6ca272f-f4b1-4895-9c7f-9ca1666e1012 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:38.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:38.875Z InvocationID=fcd702fc-b933-4889-9f5e-bce01bbf47cd 2021-07-13T00:34:39.156Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b6ca272f-f4b1-4895-9c7f-9ca1666e1012 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:39.265Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=76edf278-c344-4684-90d9-eaea1ee764b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=802 EndTimestamp=2021-07-13T00:34:39.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:38.463Z InvocationID=b829c419-4c5e-4eb4-b584-41d02fc9a25c ResponseDesc=OK 2021-07-13T00:34:39.562Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b6ca272f-f4b1-4895-9c7f-9ca1666e1012 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=687 EndTimestamp=2021-07-13T00:34:39.562Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:38.875Z InvocationID=82db95f7-8507-4d07-83ae-5e3d35f31011 ResponseDesc=OK 2021-07-13T00:34:41.766Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c671aaa1-4168-4e44-a97c-c70b1a6a6b08 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:41.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:41.766Z InvocationID=8a58f966-e35a-43cb-8874-700f0c147048 2021-07-13T00:34:41.862Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c671aaa1-4168-4e44-a97c-c70b1a6a6b08 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:42.116Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c671aaa1-4168-4e44-a97c-c70b1a6a6b08 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=349 EndTimestamp=2021-07-13T00:34:42.115Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:41.766Z InvocationID=d969a0e1-4b1d-4295-9956-43ce3dce0b43 ResponseDesc=OK 2021-07-13T00:34:44.875Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=164fea4e-f891-419b-a0a6-480a7b7cd51e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:44.875Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:44.875Z InvocationID=b9ea341d-c917-4c5a-a2b8-cdb089c00cd8 2021-07-13T00:34:45.971Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=164fea4e-f891-419b-a0a6-480a7b7cd51e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:46.169Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=164fea4e-f891-419b-a0a6-480a7b7cd51e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1294 EndTimestamp=2021-07-13T00:34:46.169Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:44.875Z InvocationID=00cf9b3c-36c8-4916-8317-ff51dda9b4be ResponseDesc=OK 2021-07-13T00:34:47.444Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=157f265a-8404-41ad-82a5-62f3ba0ecac9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:47.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:47.444Z InvocationID=967b6260-c268-40c7-863c-3698b852bdae 2021-07-13T00:34:47.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=157f265a-8404-41ad-82a5-62f3ba0ecac9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:47.958Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=157f265a-8404-41ad-82a5-62f3ba0ecac9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=514 EndTimestamp=2021-07-13T00:34:47.958Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:47.444Z InvocationID=82bb19ba-5729-4123-ac2f-cba6cbdbe6aa ResponseDesc=OK 2021-07-13T00:34:48.570Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d4caf47-4f98-412b-a499-281e0890e5ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:48.570Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:48.570Z InvocationID=3ce4b635-6834-43d0-b8b5-1991e68c77c1 2021-07-13T00:34:48.659Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d4caf47-4f98-412b-a499-281e0890e5ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:48.874Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2718a151-9208-4c99-ae62-321a08d74a5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:48.874Z InvocationID=2e55cd70-c1ad-4bcb-9b03-657bbda6fb5e 2021-07-13T00:34:49.138Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d4caf47-4f98-412b-a499-281e0890e5ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=568 EndTimestamp=2021-07-13T00:34:49.138Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:48.570Z InvocationID=7a84f920-ee03-4b04-b861-357be50a3903 ResponseDesc=OK 2021-07-13T00:34:49.861Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2718a151-9208-4c99-ae62-321a08d74a5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:50.459Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2718a151-9208-4c99-ae62-321a08d74a5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1585 EndTimestamp=2021-07-13T00:34:50.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:48.874Z InvocationID=dd11fbed-e3fd-41ff-bbd9-027716a33180 ResponseDesc=OK 2021-07-13T00:34:50.833Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=90bd8875-01bd-442e-8848-b357c15c2b76 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:50.833Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:50.833Z InvocationID=8cb96570-33af-4f31-9997-71e205322b45 2021-07-13T00:34:50.957Z [qtp817348612-66] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=90bd8875-01bd-442e-8848-b357c15c2b76 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:51.358Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=90bd8875-01bd-442e-8848-b357c15c2b76 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=524 EndTimestamp=2021-07-13T00:34:51.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:50.833Z InvocationID=6930d75d-4997-4203-ba0d-96f60fa352a2 ResponseDesc=OK 2021-07-13T00:34:54.064Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=865d34e6-b399-495a-a05e-f70e49409a85 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:54.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:54.064Z InvocationID=4ccc8397-7b91-421e-b83a-21f13a75d9c8 2021-07-13T00:34:54.161Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=865d34e6-b399-495a-a05e-f70e49409a85 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:54.418Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=865d34e6-b399-495a-a05e-f70e49409a85 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=354 EndTimestamp=2021-07-13T00:34:54.418Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:54.064Z InvocationID=35674a51-06cb-4681-9085-e60b318276d5 ResponseDesc=OK 2021-07-13T00:34:56.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5b798479-a4ac-4188-be2e-4c59f9d0ade0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:56.874Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:56.874Z InvocationID=f4fe0934-03dc-4c0d-9406-55778cdfaa53 2021-07-13T00:34:57.115Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5b798479-a4ac-4188-be2e-4c59f9d0ade0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:57.359Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5b798479-a4ac-4188-be2e-4c59f9d0ade0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=485 EndTimestamp=2021-07-13T00:34:57.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:56.874Z InvocationID=723ca546-3b31-4b8c-a5a2-5e5e28706864 ResponseDesc=OK 2021-07-13T00:34:57.440Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=25fa3179-03ba-404f-a081-a47b23272157 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:57.440Z InvocationID=71aa50e7-43f2-4713-a35f-8275052fc25b 2021-07-13T00:34:57.563Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=25fa3179-03ba-404f-a081-a47b23272157 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:57.857Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=25fa3179-03ba-404f-a081-a47b23272157 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=417 EndTimestamp=2021-07-13T00:34:57.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:57.440Z InvocationID=2b119d2c-2fbc-4830-a3c9-039be166ee03 ResponseDesc=OK 2021-07-13T00:34:58.874Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bf50c9cb-e88e-4d42-9411-a71ec1bbad65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:58.874Z InvocationID=53fffc20-bae9-44ed-8c0c-8c668e26d56c 2021-07-13T00:34:58.960Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bf50c9cb-e88e-4d42-9411-a71ec1bbad65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:34:59.313Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bf50c9cb-e88e-4d42-9411-a71ec1bbad65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:34:59.313Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:58.874Z InvocationID=0a2255b7-d54d-4126-8fec-89581d1818f4 ResponseDesc=OK 2021-07-13T00:34:59.871Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c79303d4-8c74-4c4a-890c-341c9a860846 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:34:59.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:59.871Z InvocationID=6f8b0cee-cbaf-4f50-a50c-182e6326193b 2021-07-13T00:35:00.983Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c79303d4-8c74-4c4a-890c-341c9a860846 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:01.159Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c79303d4-8c74-4c4a-890c-341c9a860846 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1288 EndTimestamp=2021-07-13T00:35:01.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:34:59.871Z InvocationID=40040583-2612-4fbb-8b1b-5011fb327911 ResponseDesc=OK 2021-07-13T00:35:02.367Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b376ed92-b55b-4b0e-be2c-dcaa95aa442c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:02.366Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:02.366Z InvocationID=a370d705-204c-44e1-aa78-98ca499206e9 2021-07-13T00:35:02.467Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b376ed92-b55b-4b0e-be2c-dcaa95aa442c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:02.771Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b376ed92-b55b-4b0e-be2c-dcaa95aa442c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=405 EndTimestamp=2021-07-13T00:35:02.771Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:02.366Z InvocationID=2a004789-1f87-4b16-a45e-6e306705d3a6 ResponseDesc=OK 2021-07-13T00:35:05.961Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=caec01ab-054d-47d5-8596-1d4264efff31 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:05.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:05.960Z InvocationID=0f224655-341f-43f5-a7e4-ace3c4fb9346 2021-07-13T00:35:06.058Z [qtp817348612-66] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=caec01ab-054d-47d5-8596-1d4264efff31 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:06.691Z [qtp817348612-66] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=caec01ab-054d-47d5-8596-1d4264efff31 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=731 EndTimestamp=2021-07-13T00:35:06.691Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:05.960Z InvocationID=576bb91e-cf5c-4b0f-a86f-652fab2b0b71 ResponseDesc=OK 2021-07-13T00:35:07.439Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=04e939a4-b889-485a-9868-fa87e32bec2d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:07.439Z InvocationID=72f51276-6a8a-4ed4-8323-fda81ae3c9d2 2021-07-13T00:35:08.519Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=04e939a4-b889-485a-9868-fa87e32bec2d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:08.760Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=04e939a4-b889-485a-9868-fa87e32bec2d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1320 EndTimestamp=2021-07-13T00:35:08.759Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:07.439Z InvocationID=9a2f6460-5a82-46a5-b516-c020f24e927d ResponseDesc=OK 2021-07-13T00:35:08.784Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8918e12f-f99d-41ed-ab52-4b07cb7104d6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:08.784Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:08.784Z InvocationID=eb52b0d1-800d-4794-b64f-dea29988b88b 2021-07-13T00:35:08.875Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6c630cf3-85f5-440b-b7b0-476b479731c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:08.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:08.875Z InvocationID=0ecba7ad-a48e-4725-b0bc-5850e04e68ee 2021-07-13T00:35:08.972Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8918e12f-f99d-41ed-ab52-4b07cb7104d6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:09.119Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6c630cf3-85f5-440b-b7b0-476b479731c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:09.157Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8918e12f-f99d-41ed-ab52-4b07cb7104d6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=373 EndTimestamp=2021-07-13T00:35:09.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:08.784Z InvocationID=2181bc25-9926-4746-b843-81d73b25915c ResponseDesc=OK 2021-07-13T00:35:09.418Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6c630cf3-85f5-440b-b7b0-476b479731c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=543 EndTimestamp=2021-07-13T00:35:09.418Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:08.875Z InvocationID=ca02e60b-f0b2-4a1f-9caa-4908877c9627 ResponseDesc=OK 2021-07-13T00:35:11.672Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4cf000aa-9a35-40b0-93e8-384b62136e0e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:11.672Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:11.672Z InvocationID=3634a00e-83b7-4c04-8dd6-ad477294aece 2021-07-13T00:35:17.120Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4cf000aa-9a35-40b0-93e8-384b62136e0e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:17.447Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=14364e23-7814-4c46-b306-44e9b0173429 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:17.446Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:17.446Z InvocationID=11320e1f-0a46-492a-b8d6-e3d310a27def 2021-07-13T00:35:17.558Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=14364e23-7814-4c46-b306-44e9b0173429 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:17.561Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4cf000aa-9a35-40b0-93e8-384b62136e0e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5889 EndTimestamp=2021-07-13T00:35:17.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:11.672Z InvocationID=2be550f2-007b-4a86-ad2f-93cc29f98319 ResponseDesc=OK 2021-07-13T00:35:17.774Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=590f209d-53ae-4700-89c6-032668dc5213 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:17.773Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:17.773Z InvocationID=dc72c8fc-52f7-428d-9198-aa74fbded0a7 2021-07-13T00:35:18.158Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=14364e23-7814-4c46-b306-44e9b0173429 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=712 EndTimestamp=2021-07-13T00:35:18.158Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:17.446Z InvocationID=06f95ad4-aae7-43f0-b1e7-4250998b4ccc ResponseDesc=OK 2021-07-13T00:35:18.158Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=590f209d-53ae-4700-89c6-032668dc5213 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:18.714Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=590f209d-53ae-4700-89c6-032668dc5213 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=940 EndTimestamp=2021-07-13T00:35:18.713Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:17.773Z InvocationID=388758a3-cc9b-4c55-b808-220d55d9f411 ResponseDesc=OK 2021-07-13T00:35:18.875Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b8d3f344-95eb-48a9-a885-0174e6da9b6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:18.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:18.875Z InvocationID=d7777de5-fdcc-4677-8c3a-587265c77b0e 2021-07-13T00:35:19.727Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bc3b9b66-5018-458e-a4a7-fc29c60f2fda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:19.727Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:19.727Z InvocationID=a496b1aa-6cf0-4752-a170-3f5f1da15127 2021-07-13T00:35:19.911Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b8d3f344-95eb-48a9-a885-0174e6da9b6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:20.060Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bc3b9b66-5018-458e-a4a7-fc29c60f2fda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:20.161Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b8d3f344-95eb-48a9-a885-0174e6da9b6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1285 EndTimestamp=2021-07-13T00:35:20.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:18.875Z InvocationID=702f876c-efa5-4be2-92e7-aff82410270d ResponseDesc=OK 2021-07-13T00:35:20.458Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bc3b9b66-5018-458e-a4a7-fc29c60f2fda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=730 EndTimestamp=2021-07-13T00:35:20.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:19.727Z InvocationID=fd377881-7a4c-4708-af62-7fcd61ea5f3f ResponseDesc=OK 2021-07-13T00:35:21.369Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=73f1bb80-f314-45d4-a096-895df0840994 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:21.368Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:21.368Z InvocationID=322c1573-7d4d-4317-b2f7-3d7d0627b398 2021-07-13T00:35:21.459Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=73f1bb80-f314-45d4-a096-895df0840994 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:22.131Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=73f1bb80-f314-45d4-a096-895df0840994 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=763 EndTimestamp=2021-07-13T00:35:22.131Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:21.368Z InvocationID=960051ef-cdfa-42fa-9862-f6e9c813c53b ResponseDesc=OK 2021-07-13T00:35:23.377Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5fc5a79f-1c7d-4fa9-a6b1-099988de8154 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:23.376Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:23.376Z InvocationID=288c8d0c-cbdd-428b-b763-90359c7b6b77 2021-07-13T00:35:23.926Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5fc5a79f-1c7d-4fa9-a6b1-099988de8154 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:24.159Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5fc5a79f-1c7d-4fa9-a6b1-099988de8154 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=783 EndTimestamp=2021-07-13T00:35:24.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:23.376Z InvocationID=0d32802b-ee28-42fd-a468-922f70359765 ResponseDesc=OK 2021-07-13T00:35:26.925Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=68d34b0c-279a-4936-9fda-c9e032956fd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:26.925Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:26.925Z InvocationID=e2733e02-be10-4640-956e-07302d0b71c8 2021-07-13T00:35:27.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a1e0463b-6ce5-4ee2-8e10-f4689bd51c05 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:27.439Z InvocationID=c246f7ca-00ed-4ede-8515-3b3a4eb4551c 2021-07-13T00:35:27.757Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=68d34b0c-279a-4936-9fda-c9e032956fd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:28.874Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7054ba45-c795-46e5-934a-0e6e57274440 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:28.874Z InvocationID=6115c2f5-5cd0-4787-b849-0dcaf86163b5 2021-07-13T00:35:28.958Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=68d34b0c-279a-4936-9fda-c9e032956fd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2033 EndTimestamp=2021-07-13T00:35:28.958Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:26.925Z InvocationID=7c62730a-9e5d-436f-afc0-a0042dae66cd ResponseDesc=OK 2021-07-13T00:35:28.971Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a1e0463b-6ce5-4ee2-8e10-f4689bd51c05 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:29.664Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7054ba45-c795-46e5-934a-0e6e57274440 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:29.723Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a1e0463b-6ce5-4ee2-8e10-f4689bd51c05 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2284 EndTimestamp=2021-07-13T00:35:29.723Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:27.439Z InvocationID=444f655c-ce63-4dda-a1a1-f000235790eb ResponseDesc=OK 2021-07-13T00:35:29.868Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7054ba45-c795-46e5-934a-0e6e57274440 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=993 EndTimestamp=2021-07-13T00:35:29.867Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:28.874Z InvocationID=215de4dd-c108-4e34-9cfd-e1ff63f70565 ResponseDesc=OK 2021-07-13T00:35:30.275Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=18c41bb6-85c9-4f3e-82e4-faa130b529dd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:30.274Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:30.274Z InvocationID=33f6ce66-89e2-447a-b1e7-fdc3e02c692d 2021-07-13T00:35:30.457Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=18c41bb6-85c9-4f3e-82e4-faa130b529dd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:30.758Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=18c41bb6-85c9-4f3e-82e4-faa130b529dd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=484 EndTimestamp=2021-07-13T00:35:30.758Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:30.274Z InvocationID=cfd51f08-7390-4e7e-93bd-502eb3a834c8 ResponseDesc=OK 2021-07-13T00:35:32.871Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c9ddb8f4-f7f9-4993-bf57-5434a8c87073 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:32.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:32.871Z InvocationID=d0e31bb4-b16d-4567-966c-7e76b17d685d 2021-07-13T00:35:32.967Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c9ddb8f4-f7f9-4993-bf57-5434a8c87073 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:33.440Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c9ddb8f4-f7f9-4993-bf57-5434a8c87073 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=568 EndTimestamp=2021-07-13T00:35:33.439Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:32.871Z InvocationID=0597e86c-a76e-4805-9866-36426ccde14b ResponseDesc=OK 2021-07-13T00:35:36.321Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0d992e24-1af0-4819-b75e-44a5f4b0c577 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:36.321Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:36.321Z InvocationID=726e5e6c-e640-4cd6-9e75-b5bfe1e2d872 2021-07-13T00:35:36.778Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0d992e24-1af0-4819-b75e-44a5f4b0c577 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:36.873Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0d992e24-1af0-4819-b75e-44a5f4b0c577 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=552 EndTimestamp=2021-07-13T00:35:36.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:36.321Z InvocationID=3ebed73f-5bb0-4cce-b178-7926ea73f9e6 ResponseDesc=OK 2021-07-13T00:35:37.440Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7f5f06a7-5bcd-4b37-9b00-9476361d9bb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:37.440Z InvocationID=686066a3-e6f5-4867-adb0-406e4dc7ff23 2021-07-13T00:35:37.557Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7f5f06a7-5bcd-4b37-9b00-9476361d9bb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:37.757Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7f5f06a7-5bcd-4b37-9b00-9476361d9bb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=316 EndTimestamp=2021-07-13T00:35:37.756Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:37.440Z InvocationID=3c2e2fd8-66d7-436e-aefb-1e90ce9c89c6 ResponseDesc=OK 2021-07-13T00:35:38.767Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8cdb7056-497b-4911-b648-82fc9e403d9e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:38.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:38.767Z InvocationID=f6d8df15-b8c0-434a-a685-02d343693c3e 2021-07-13T00:35:38.860Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8cdb7056-497b-4911-b648-82fc9e403d9e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:38.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=98e9e1ed-31c7-4894-bd5b-7bbafa9b5510 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:38.874Z InvocationID=5fd3b47e-b38c-4123-aab7-3f945d79b809 2021-07-13T00:35:40.968Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8cdb7056-497b-4911-b648-82fc9e403d9e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2201 EndTimestamp=2021-07-13T00:35:40.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:38.767Z InvocationID=7daad8fd-4ddd-4508-aaef-cce4d00e7733 ResponseDesc=OK 2021-07-13T00:35:40.970Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=98e9e1ed-31c7-4894-bd5b-7bbafa9b5510 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:41.660Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=98e9e1ed-31c7-4894-bd5b-7bbafa9b5510 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2786 EndTimestamp=2021-07-13T00:35:41.660Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:38.874Z InvocationID=6b93dc98-a34c-4ebd-ac83-8ffc4d34cfa5 ResponseDesc=OK 2021-07-13T00:35:42.163Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9ca68d7a-e556-4de4-8325-0ef052da6ccf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:42.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:42.163Z InvocationID=5efe0f17-1130-4d4a-a839-f2611af83aa7 2021-07-13T00:35:42.257Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9ca68d7a-e556-4de4-8325-0ef052da6ccf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:47.440Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5291665e-5c8b-4c5e-be45-22db171745c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:47.439Z InvocationID=1dac72ec-8a60-41cb-be7b-58252381ffc0 2021-07-13T00:35:48.874Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ba78ca0b-7923-4a32-9bae-b669d05a2c17 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:48.874Z InvocationID=f75b4083-4feb-422f-9996-d627e79047f9 2021-07-13T00:35:48.880Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5291665e-5c8b-4c5e-be45-22db171745c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:49.058Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ba78ca0b-7923-4a32-9bae-b669d05a2c17 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:49.059Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9ca68d7a-e556-4de4-8325-0ef052da6ccf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=6896 EndTimestamp=2021-07-13T00:35:49.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:42.163Z InvocationID=b2855175-aaff-42cf-89c0-c5633028b8ec ResponseDesc=OK 2021-07-13T00:35:49.346Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5291665e-5c8b-4c5e-be45-22db171745c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1907 EndTimestamp=2021-07-13T00:35:49.346Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:47.439Z InvocationID=fe744425-92d5-431c-83b1-fa5906dea459 ResponseDesc=OK 2021-07-13T00:35:49.362Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ba78ca0b-7923-4a32-9bae-b669d05a2c17 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=488 EndTimestamp=2021-07-13T00:35:49.362Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:48.874Z InvocationID=cb830a0c-70e5-407e-a6ad-58f0c81b77c2 ResponseDesc=OK 2021-07-13T00:35:49.822Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be0e7a63-cd7e-4b45-86c8-48db8fe1ce27 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:49.822Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:49.822Z InvocationID=ffeccd3d-15e7-4597-97ac-c86517d2fec8 2021-07-13T00:35:49.957Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be0e7a63-cd7e-4b45-86c8-48db8fe1ce27 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:50.257Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be0e7a63-cd7e-4b45-86c8-48db8fe1ce27 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=435 EndTimestamp=2021-07-13T00:35:50.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:49.822Z InvocationID=c80c06ca-6a47-450e-8e47-ed78fca31c36 ResponseDesc=OK 2021-07-13T00:35:51.144Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cacd4a57-d8d2-46b4-9be9-6f8cd87cc27b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:51.144Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:51.144Z InvocationID=8df05031-8dee-4ea3-81d7-4c15b7d7b296 2021-07-13T00:35:51.260Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cacd4a57-d8d2-46b4-9be9-6f8cd87cc27b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:51.527Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cacd4a57-d8d2-46b4-9be9-6f8cd87cc27b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=383 EndTimestamp=2021-07-13T00:35:51.527Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:51.144Z InvocationID=fc546509-b03a-4fbe-bf4d-dd1ba85577dd ResponseDesc=OK 2021-07-13T00:35:55.390Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4a9d1b2f-73e1-46ff-a807-694855090360 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:55.390Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:55.390Z InvocationID=de7a124e-f527-448b-864a-c5307809dad8 2021-07-13T00:35:55.673Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4a9d1b2f-73e1-46ff-a807-694855090360 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:55.767Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4a9d1b2f-73e1-46ff-a807-694855090360 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=377 EndTimestamp=2021-07-13T00:35:55.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:55.390Z InvocationID=5db045d5-4d95-4926-bef3-7954ce62d9cd ResponseDesc=OK 2021-07-13T00:35:56.717Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1848ffba-613d-48c7-8e3f-9b9c253f1cf8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:56.717Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:56.717Z InvocationID=4b8daa03-338c-4fed-a754-a6468be9aab4 2021-07-13T00:35:56.857Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1848ffba-613d-48c7-8e3f-9b9c253f1cf8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:57.259Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1848ffba-613d-48c7-8e3f-9b9c253f1cf8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=541 EndTimestamp=2021-07-13T00:35:57.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:56.717Z InvocationID=92dade0b-5d49-41b1-b7b7-f03e3953b1e2 ResponseDesc=OK 2021-07-13T00:35:57.440Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=465a831b-8503-46d6-81c1-96b57a073a5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:57.440Z InvocationID=6058390c-a9cc-42ae-ac9b-00c397c99981 2021-07-13T00:35:57.560Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=465a831b-8503-46d6-81c1-96b57a073a5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:58.464Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1eb47325-e7d3-4573-a92b-e2d3f40f1c81 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:58.464Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:58.464Z InvocationID=2b71dc56-5507-40bf-a37a-1b84736674b8 2021-07-13T00:35:58.675Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=465a831b-8503-46d6-81c1-96b57a073a5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1235 EndTimestamp=2021-07-13T00:35:58.675Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:57.440Z InvocationID=817d4f9f-896b-47dc-acba-5bc8688dac18 ResponseDesc=OK 2021-07-13T00:35:58.726Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1eb47325-e7d3-4573-a92b-e2d3f40f1c81 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:58.873Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e884d22f-6a48-4b4e-84a3-1063f952be3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:35:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:58.873Z InvocationID=036ee9fa-871c-4eed-8055-b7da865388c2 2021-07-13T00:35:59.057Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e884d22f-6a48-4b4e-84a3-1063f952be3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:35:59.465Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1eb47325-e7d3-4573-a92b-e2d3f40f1c81 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1000 EndTimestamp=2021-07-13T00:35:59.464Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:58.464Z InvocationID=9a29e48b-bbcd-4987-9881-5b7a6afa09b5 ResponseDesc=OK 2021-07-13T00:35:59.564Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e884d22f-6a48-4b4e-84a3-1063f952be3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=691 EndTimestamp=2021-07-13T00:35:59.564Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:35:58.873Z InvocationID=5ec6bfdb-ebdc-4382-b1d5-48aa638a5e95 ResponseDesc=OK 2021-07-13T00:36:00.569Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1fad7da1-108a-42ad-b339-1f063523506e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:00.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:00.569Z InvocationID=65914022-677b-4761-9837-07509b827ef1 2021-07-13T00:36:00.659Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1fad7da1-108a-42ad-b339-1f063523506e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:00.861Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1fad7da1-108a-42ad-b339-1f063523506e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=291 EndTimestamp=2021-07-13T00:36:00.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:00.569Z InvocationID=f2072de8-df1d-41d4-9c86-03f732bf9683 ResponseDesc=OK 2021-07-13T00:36:02.862Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d3272963-a354-44a8-9c23-29254eb6c080 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:02.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:02.862Z InvocationID=98cd079e-527a-4624-981c-d8f2ecc59ab2 2021-07-13T00:36:04.217Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d3272963-a354-44a8-9c23-29254eb6c080 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:04.312Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d3272963-a354-44a8-9c23-29254eb6c080 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1449 EndTimestamp=2021-07-13T00:36:04.311Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:02.862Z InvocationID=4a8cef2c-9cb0-4cb7-86ca-536f01e0672c ResponseDesc=OK 2021-07-13T00:36:06.525Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=779e7d1c-023e-41b7-a389-718fec082f51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:06.525Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:06.525Z InvocationID=5f1b43f8-cb39-4f81-a33c-46ec64cdbe47 2021-07-13T00:36:06.658Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=779e7d1c-023e-41b7-a389-718fec082f51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:07.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6170ecd6-af30-4e76-b860-a2c410a0adda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:07.439Z InvocationID=770cd185-d9c7-405a-b968-ba8e973a5fb1 2021-07-13T00:36:07.658Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6170ecd6-af30-4e76-b860-a2c410a0adda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:08.358Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=779e7d1c-023e-41b7-a389-718fec082f51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1833 EndTimestamp=2021-07-13T00:36:08.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:06.525Z InvocationID=2edfd6f0-036a-473e-802b-a7461453ef96 ResponseDesc=OK 2021-07-13T00:36:08.521Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6170ecd6-af30-4e76-b860-a2c410a0adda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1082 EndTimestamp=2021-07-13T00:36:08.521Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:07.439Z InvocationID=f896a3ec-ea27-49d5-bd50-78e98294e3e2 ResponseDesc=OK 2021-07-13T00:36:08.873Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e1a45bcf-9d1f-4c67-9542-bf57fcfbda1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:08.873Z InvocationID=e62186cb-b27c-4424-936c-cd379efa878d 2021-07-13T00:36:09.041Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e1a45bcf-9d1f-4c67-9542-bf57fcfbda1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:09.261Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e1a45bcf-9d1f-4c67-9542-bf57fcfbda1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=388 EndTimestamp=2021-07-13T00:36:09.261Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:08.873Z InvocationID=c7328380-dd57-448f-8e58-e6b66be3352c ResponseDesc=OK 2021-07-13T00:36:09.266Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d1c28563-fba0-4db9-8851-63c7b4b42582 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:09.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:09.265Z InvocationID=6a3d910d-b1ff-472d-bda7-bd381c10dc78 2021-07-13T00:36:09.457Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d1c28563-fba0-4db9-8851-63c7b4b42582 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:09.858Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d1c28563-fba0-4db9-8851-63c7b4b42582 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=593 EndTimestamp=2021-07-13T00:36:09.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:09.265Z InvocationID=1695b7af-f028-42cf-ab73-eb859adbe42a ResponseDesc=OK 2021-07-13T00:36:11.978Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=90542f9d-f927-4c51-a4fe-01a809bdfc54 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:11.977Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:11.977Z InvocationID=0d3b0048-5b6f-42e2-b246-06ad35deea65 2021-07-13T00:36:12.060Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=90542f9d-f927-4c51-a4fe-01a809bdfc54 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:12.316Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=90542f9d-f927-4c51-a4fe-01a809bdfc54 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=339 EndTimestamp=2021-07-13T00:36:12.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:11.977Z InvocationID=6d306193-dadc-4662-983b-0cd642e9feb9 ResponseDesc=OK 2021-07-13T00:36:14.976Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6935c00c-d1bc-4126-a1f5-a59678b9a905 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:14.975Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:14.975Z InvocationID=cae0f224-e1c3-4af7-a2d6-f82fa92182b6 2021-07-13T00:36:17.439Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5839f619-1f7c-4406-9b66-f9150616da43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:17.439Z InvocationID=8be61ff9-c9db-4614-bb18-b4e32e1a00e2 2021-07-13T00:36:18.139Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6935c00c-d1bc-4126-a1f5-a59678b9a905 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:18.159Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5839f619-1f7c-4406-9b66-f9150616da43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:18.361Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6935c00c-d1bc-4126-a1f5-a59678b9a905 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3386 EndTimestamp=2021-07-13T00:36:18.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:14.975Z InvocationID=51e32d32-4a4c-49c2-bdad-47e36c1a671e ResponseDesc=OK 2021-07-13T00:36:18.557Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5839f619-1f7c-4406-9b66-f9150616da43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1118 EndTimestamp=2021-07-13T00:36:18.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:17.439Z InvocationID=a2b39d06-e598-4e59-b761-14172bbb904e ResponseDesc=OK 2021-07-13T00:36:18.878Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fd8edcee-87fc-4263-b831-2d0196c41cb0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:18.878Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:18.878Z InvocationID=e9551b7d-01f1-4015-aaf8-8e2d467a815b 2021-07-13T00:36:19.059Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fd8edcee-87fc-4263-b831-2d0196c41cb0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:19.159Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d4e2e073-f277-4e61-adb8-992e654b6361 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:19.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:19.159Z InvocationID=efa0b1ea-4697-4515-b7ca-27465197a49e 2021-07-13T00:36:19.315Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d4e2e073-f277-4e61-adb8-992e654b6361 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:19.316Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fd8edcee-87fc-4263-b831-2d0196c41cb0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=438 EndTimestamp=2021-07-13T00:36:19.316Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:18.878Z InvocationID=60d5511a-0a7c-4484-97d9-eb452743faab ResponseDesc=OK 2021-07-13T00:36:19.559Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d4e2e073-f277-4e61-adb8-992e654b6361 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=400 EndTimestamp=2021-07-13T00:36:19.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:19.159Z InvocationID=28c152e4-6a33-4202-a4f2-9c7c01a48b4e ResponseDesc=OK 2021-07-13T00:36:21.516Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=72c07f84-34b8-4301-9c55-0b56ec997d4d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:21.516Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:21.516Z InvocationID=e7428546-64bd-48b8-b7bd-b89a917a65cd 2021-07-13T00:36:21.658Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=72c07f84-34b8-4301-9c55-0b56ec997d4d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:22.161Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=72c07f84-34b8-4301-9c55-0b56ec997d4d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=645 EndTimestamp=2021-07-13T00:36:22.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:21.516Z InvocationID=077c9693-dce2-4048-966b-e5fa0ad98656 ResponseDesc=OK 2021-07-13T00:36:23.672Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d1e44e1-d9ca-4449-9b25-6cc37c6d4477 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:23.672Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:23.672Z InvocationID=47c2ccf3-6cec-4f49-87b6-b70e0a6e7547 2021-07-13T00:36:23.761Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d1e44e1-d9ca-4449-9b25-6cc37c6d4477 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:24.023Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2d1e44e1-d9ca-4449-9b25-6cc37c6d4477 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=351 EndTimestamp=2021-07-13T00:36:24.023Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:23.672Z InvocationID=991b436b-433d-4d2a-abdf-a0e5f08ecd86 ResponseDesc=OK 2021-07-13T00:36:27.440Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3e4a9a8e-aa7d-4625-9f88-a3393efc26cc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:27.440Z InvocationID=7406a1a7-e198-4373-9475-e453c03b3ab9 2021-07-13T00:36:27.961Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=06e65fe6-9e08-4fb4-86bd-1c249ca48184 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:27.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:27.961Z InvocationID=978f6ac6-97b1-45bb-b074-d973755ca5ed 2021-07-13T00:36:28.649Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3e4a9a8e-aa7d-4625-9f88-a3393efc26cc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:28.862Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3e4a9a8e-aa7d-4625-9f88-a3393efc26cc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1422 EndTimestamp=2021-07-13T00:36:28.862Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:27.440Z InvocationID=120e0776-92b5-49d7-8bed-3119721e01e3 ResponseDesc=OK 2021-07-13T00:36:28.873Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d2ebe8eb-e145-443a-9818-07bb8e0f4249 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:28.873Z InvocationID=8e2b27c7-ba8b-4891-8c18-6f64a1c3e7e4 2021-07-13T00:36:29.059Z [qtp817348612-70] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=06e65fe6-9e08-4fb4-86bd-1c249ca48184 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:29.114Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d2ebe8eb-e145-443a-9818-07bb8e0f4249 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:29.263Z [qtp817348612-70] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=06e65fe6-9e08-4fb4-86bd-1c249ca48184 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1302 EndTimestamp=2021-07-13T00:36:29.263Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:27.961Z InvocationID=6bae4e2e-9064-4abf-aaad-0ccf996470d1 ResponseDesc=OK 2021-07-13T00:36:29.523Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d2ebe8eb-e145-443a-9818-07bb8e0f4249 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=650 EndTimestamp=2021-07-13T00:36:29.523Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:28.873Z InvocationID=8bde9a10-7889-493d-970b-7eea9e0917f9 ResponseDesc=OK 2021-07-13T00:36:30.473Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=09a5c98d-e5de-4783-bdd6-0b23655df05d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:30.472Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:30.472Z InvocationID=17caa9d2-8c46-4f1f-bfb7-491cb2403095 2021-07-13T00:36:30.682Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=09a5c98d-e5de-4783-bdd6-0b23655df05d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:30.859Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=09a5c98d-e5de-4783-bdd6-0b23655df05d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=387 EndTimestamp=2021-07-13T00:36:30.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:30.472Z InvocationID=28bb7346-580e-4fd1-aff7-76ad5898eb29 ResponseDesc=OK 2021-07-13T00:36:33.825Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7268e89f-a22c-49e6-87c4-3a1bec5441c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:33.824Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:33.824Z InvocationID=94d95eab-49f8-410e-a493-46dc18223813 2021-07-13T00:36:33.957Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7268e89f-a22c-49e6-87c4-3a1bec5441c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:34.464Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7268e89f-a22c-49e6-87c4-3a1bec5441c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=640 EndTimestamp=2021-07-13T00:36:34.464Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:33.824Z InvocationID=4e0066eb-279e-478d-a346-06f1055a52de ResponseDesc=OK 2021-07-13T00:36:36.161Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f14f5f6c-86a0-4dfd-83df-93ea0d041b54 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:36.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:36.161Z InvocationID=2e762040-dd42-4cb5-b3e9-47bd2b5c2ea5 2021-07-13T00:36:36.259Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f14f5f6c-86a0-4dfd-83df-93ea0d041b54 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:36.513Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f14f5f6c-86a0-4dfd-83df-93ea0d041b54 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=352 EndTimestamp=2021-07-13T00:36:36.513Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:36.161Z InvocationID=c8c78db0-f73d-4be2-83eb-56c9bd7b2117 ResponseDesc=OK 2021-07-13T00:36:37.439Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=874cca17-d9ae-406d-8c9f-38d9f1fde070 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:37.439Z InvocationID=f13e81d2-0773-49eb-ad53-a2f7967fc9bb 2021-07-13T00:36:37.619Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=874cca17-d9ae-406d-8c9f-38d9f1fde070 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:37.863Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=874cca17-d9ae-406d-8c9f-38d9f1fde070 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=424 EndTimestamp=2021-07-13T00:36:37.863Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:37.439Z InvocationID=6f638c9b-5e8f-4eff-89ef-3f81ebe217b1 ResponseDesc=OK 2021-07-13T00:36:38.875Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a3888d50-10e2-4698-ac1b-83081129e84a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:38.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:38.875Z InvocationID=d0eab743-097a-47b4-b5fd-131910335861 2021-07-13T00:36:39.057Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a3888d50-10e2-4698-ac1b-83081129e84a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:39.838Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=65eabeec-0336-4e3b-8ea2-ea10e57637c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:39.837Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:39.837Z InvocationID=f8f9f04e-c194-49b2-be10-d9b3d4260257 2021-07-13T00:36:39.867Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a3888d50-10e2-4698-ac1b-83081129e84a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=992 EndTimestamp=2021-07-13T00:36:39.867Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:38.875Z InvocationID=85b174f4-670d-4a28-8fd5-21b1e07a7b07 ResponseDesc=OK 2021-07-13T00:36:39.959Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=65eabeec-0336-4e3b-8ea2-ea10e57637c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:40.315Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=65eabeec-0336-4e3b-8ea2-ea10e57637c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=478 EndTimestamp=2021-07-13T00:36:40.315Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:39.837Z InvocationID=4567c5e6-af6f-4d3d-a39b-1e32ecb34e44 ResponseDesc=OK 2021-07-13T00:36:41.869Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6739d07b-bfde-4483-8846-0fcaefb7fff8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:41.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:41.869Z InvocationID=3959c54f-8bb8-4013-83ce-0b5a7e42f73b 2021-07-13T00:36:42.111Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6739d07b-bfde-4483-8846-0fcaefb7fff8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:42.361Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6739d07b-bfde-4483-8846-0fcaefb7fff8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=492 EndTimestamp=2021-07-13T00:36:42.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:41.869Z InvocationID=f2f6da6b-9a7b-491d-8186-6d16127791c6 ResponseDesc=OK 2021-07-13T00:36:44.768Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2b96d3f9-2e80-4f0c-8df7-cec08c6ec771 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:44.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:44.768Z InvocationID=2c51932e-e40a-40fb-83d0-7680c0b163e7 2021-07-13T00:36:44.957Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2b96d3f9-2e80-4f0c-8df7-cec08c6ec771 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:45.257Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2b96d3f9-2e80-4f0c-8df7-cec08c6ec771 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=489 EndTimestamp=2021-07-13T00:36:45.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:44.768Z InvocationID=28de11df-a4eb-40f7-9a4d-a03c6a8e6b85 ResponseDesc=OK 2021-07-13T00:36:47.440Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7d4c1543-fe7d-401e-a3e5-551a7eba9d88 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:47.440Z InvocationID=775e4ca8-f977-4191-a1d8-5b6c17c39a3e 2021-07-13T00:36:47.559Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7d4c1543-fe7d-401e-a3e5-551a7eba9d88 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:47.860Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7ceee74d-c79b-406c-9403-3af1feeeedb5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:47.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:47.860Z InvocationID=dba947b5-e4f4-4ecb-a88e-b15113569800 2021-07-13T00:36:48.875Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ef4007fc-8b55-4e16-b585-063fb45c72c0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:48.875Z InvocationID=c1b2c770-2a68-419f-846f-87ce338b27b8 2021-07-13T00:36:49.559Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ef4007fc-8b55-4e16-b585-063fb45c72c0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:49.760Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ef4007fc-8b55-4e16-b585-063fb45c72c0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=885 EndTimestamp=2021-07-13T00:36:49.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:48.875Z InvocationID=39a3c252-521b-4ea9-b429-c95b8f42cee3 ResponseDesc=OK 2021-07-13T00:36:50.119Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7ceee74d-c79b-406c-9403-3af1feeeedb5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:50.325Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7d4c1543-fe7d-401e-a3e5-551a7eba9d88 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2885 EndTimestamp=2021-07-13T00:36:50.325Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:47.440Z InvocationID=386b924d-e22d-4bd0-ae1f-e9135d142a04 ResponseDesc=OK 2021-07-13T00:36:50.458Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7ceee74d-c79b-406c-9403-3af1feeeedb5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2598 EndTimestamp=2021-07-13T00:36:50.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:47.860Z InvocationID=97ac57ea-3e81-4cf3-9ac9-b9487f2111c6 ResponseDesc=OK 2021-07-13T00:36:51.265Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e101d8e7-f4e6-4c66-aab3-2fa9e814c871 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:51.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:51.265Z InvocationID=87c79111-a87e-407e-b282-a663eb7fe7ce 2021-07-13T00:36:51.369Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e101d8e7-f4e6-4c66-aab3-2fa9e814c871 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:51.613Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e101d8e7-f4e6-4c66-aab3-2fa9e814c871 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=348 EndTimestamp=2021-07-13T00:36:51.613Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:51.265Z InvocationID=2b561ef9-fdac-4a2a-af6d-6a29393ef2cc ResponseDesc=OK 2021-07-13T00:36:53.862Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ecbfb34f-2a11-441d-8a62-0b0b5d18971d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:53.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:53.862Z InvocationID=746544eb-ac2d-4d3d-8ce9-3720fa19588d 2021-07-13T00:36:54.820Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ecbfb34f-2a11-441d-8a62-0b0b5d18971d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:54.960Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ecbfb34f-2a11-441d-8a62-0b0b5d18971d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1098 EndTimestamp=2021-07-13T00:36:54.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:53.862Z InvocationID=db3ef147-9f08-474a-be0c-e3e67e544c3c ResponseDesc=OK 2021-07-13T00:36:57.160Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=924f84bb-ae81-4fac-9d87-8e038db17732 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:57.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:57.160Z InvocationID=b9ee0e85-8267-4fd1-bab5-5b4d116cb525 2021-07-13T00:36:57.257Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=924f84bb-ae81-4fac-9d87-8e038db17732 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:57.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fba51b40-1533-43dc-aacc-f362d0c2bb7b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:57.439Z InvocationID=94b09846-5080-46bd-8b47-743c989163d8 2021-07-13T00:36:57.760Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fba51b40-1533-43dc-aacc-f362d0c2bb7b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:57.958Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=924f84bb-ae81-4fac-9d87-8e038db17732 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=798 EndTimestamp=2021-07-13T00:36:57.958Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:57.160Z InvocationID=8a9a4740-f245-4ea4-b6c1-7e9662723fd3 ResponseDesc=OK 2021-07-13T00:36:58.113Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fba51b40-1533-43dc-aacc-f362d0c2bb7b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=674 EndTimestamp=2021-07-13T00:36:58.113Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:57.439Z InvocationID=70462332-7e07-4a84-93de-33f05d295218 ResponseDesc=OK 2021-07-13T00:36:58.874Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c13813ad-b04b-4720-a1f2-c339f1163c4d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:58.874Z InvocationID=580b3812-4273-49be-9073-77b97c34950a 2021-07-13T00:36:59.612Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c13813ad-b04b-4720-a1f2-c339f1163c4d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:36:59.773Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c13813ad-b04b-4720-a1f2-c339f1163c4d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=899 EndTimestamp=2021-07-13T00:36:59.773Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:58.874Z InvocationID=39e43a41-4531-4298-95b6-24702862caf0 ResponseDesc=OK 2021-07-13T00:36:59.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5adfc3cf-ba06-4770-898e-d80870bbd960 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:36:59.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:59.873Z InvocationID=ea06b298-5745-4b96-bccb-a20b22bd0e1d 2021-07-13T00:37:00.056Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5adfc3cf-ba06-4770-898e-d80870bbd960 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:00.879Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5adfc3cf-ba06-4770-898e-d80870bbd960 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1006 EndTimestamp=2021-07-13T00:37:00.879Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:36:59.873Z InvocationID=3b3fbe94-95e9-4f1a-9305-9118dfca8cc1 ResponseDesc=OK 2021-07-13T00:37:02.736Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1726fa78-22c1-4f0b-9a3c-6ad80f26341e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:02.736Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:02.736Z InvocationID=b2f9fe35-ef90-41b0-bef5-a6ec05c8a13c 2021-07-13T00:37:02.859Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1726fa78-22c1-4f0b-9a3c-6ad80f26341e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:03.331Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1726fa78-22c1-4f0b-9a3c-6ad80f26341e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=595 EndTimestamp=2021-07-13T00:37:03.331Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:02.736Z InvocationID=e00c8399-0892-4f63-9fe9-7467de1689f9 ResponseDesc=OK 2021-07-13T00:37:05.869Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5f5de87-b2cd-4cf2-b97a-2d49e729ac7a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:05.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:05.869Z InvocationID=0eb6a4be-d84e-4465-a6de-065b11d376c7 2021-07-13T00:37:06.118Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5f5de87-b2cd-4cf2-b97a-2d49e729ac7a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:06.363Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f5f5de87-b2cd-4cf2-b97a-2d49e729ac7a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=494 EndTimestamp=2021-07-13T00:37:06.363Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:05.869Z InvocationID=f62f3960-0b1f-4a0d-9634-6ab27a19d939 ResponseDesc=OK 2021-07-13T00:37:07.442Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c7b385ae-c3a5-45e0-b29c-df7331a9b05f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:07.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:07.442Z InvocationID=200e9438-f00e-4395-a312-3ec7bfab36e9 2021-07-13T00:37:07.563Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c7b385ae-c3a5-45e0-b29c-df7331a9b05f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:08.358Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c7b385ae-c3a5-45e0-b29c-df7331a9b05f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=916 EndTimestamp=2021-07-13T00:37:08.358Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:07.442Z InvocationID=6c0bd7e8-0c80-49c7-91b2-46d7a78590c7 ResponseDesc=OK 2021-07-13T00:37:08.864Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f82bb23f-246d-4cf5-aa71-2364c80c638e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:08.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:08.864Z InvocationID=f2c8f42a-83ec-4362-88d8-7bfe75eec8d7 2021-07-13T00:37:08.873Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=35655a47-349a-402d-ba85-28ef18d31162 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:08.873Z InvocationID=701de6d8-824d-4191-a6fb-f6a8bf404c11 2021-07-13T00:37:08.959Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f82bb23f-246d-4cf5-aa71-2364c80c638e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:09.157Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=35655a47-349a-402d-ba85-28ef18d31162 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:09.427Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=35655a47-349a-402d-ba85-28ef18d31162 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=554 EndTimestamp=2021-07-13T00:37:09.427Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:08.873Z InvocationID=1ebbc714-dd0e-4802-a85d-510f6ecddd12 ResponseDesc=OK 2021-07-13T00:37:09.460Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f82bb23f-246d-4cf5-aa71-2364c80c638e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=596 EndTimestamp=2021-07-13T00:37:09.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:08.864Z InvocationID=7dd77ae4-ba8d-4457-9606-fffcc09df39d ResponseDesc=OK 2021-07-13T00:37:11.874Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7c9f2761-9e4e-4a19-9ca7-c3ae7d61dea0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:11.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:11.873Z InvocationID=a5d7ca44-47a3-4890-b569-0faf17b0ca4d 2021-07-13T00:37:12.056Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7c9f2761-9e4e-4a19-9ca7-c3ae7d61dea0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:12.357Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7c9f2761-9e4e-4a19-9ca7-c3ae7d61dea0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=484 EndTimestamp=2021-07-13T00:37:12.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:11.873Z InvocationID=240b38ef-1b26-40b3-bf15-4e4985da5fa3 ResponseDesc=OK 2021-07-13T00:37:14.866Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=37783b0f-8a54-4c72-8aa7-0c4b675b352a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:14.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:14.866Z InvocationID=496fa496-a3a5-4670-9913-00bc3fddce7f 2021-07-13T00:37:14.961Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=37783b0f-8a54-4c72-8aa7-0c4b675b352a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:17.441Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a8e5e41d-c6bd-4163-a268-9698613d9389 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:17.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:17.440Z InvocationID=d1faf0e2-3429-406c-9797-a1918da39515 2021-07-13T00:37:18.873Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8da6b03a-3829-43dd-87cd-1e4f054b2f80 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:18.873Z InvocationID=77d27788-eaee-44fd-a847-2ceee87d5c75 2021-07-13T00:37:20.159Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8da6b03a-3829-43dd-87cd-1e4f054b2f80 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:21.419Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=37783b0f-8a54-4c72-8aa7-0c4b675b352a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=6553 EndTimestamp=2021-07-13T00:37:21.419Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:14.866Z InvocationID=dd2d8d8a-5ff6-41de-ae4a-9eb4eb94d0da ResponseDesc=OK 2021-07-13T00:37:21.560Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8da6b03a-3829-43dd-87cd-1e4f054b2f80 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2687 EndTimestamp=2021-07-13T00:37:21.560Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:18.873Z InvocationID=90c00945-22be-4fca-aaed-dfbf14b98efc ResponseDesc=OK 2021-07-13T00:37:21.911Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a8e5e41d-c6bd-4163-a268-9698613d9389 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:22.359Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a8e5e41d-c6bd-4163-a268-9698613d9389 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4919 EndTimestamp=2021-07-13T00:37:22.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:17.440Z InvocationID=08a23718-87c9-47a2-8945-3090ae171fc5 ResponseDesc=OK 2021-07-13T00:37:23.070Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=68d77f45-6924-4453-b41d-ba18a5f20c97 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:23.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:23.069Z InvocationID=3a90dd7e-89cd-47e8-967d-f9e091f64360 2021-07-13T00:37:23.159Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=68d77f45-6924-4453-b41d-ba18a5f20c97 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:23.712Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=68d77f45-6924-4453-b41d-ba18a5f20c97 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=643 EndTimestamp=2021-07-13T00:37:23.712Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:23.069Z InvocationID=d83d1587-7458-4df3-b698-cdd0c7222e12 ResponseDesc=OK 2021-07-13T00:37:25.635Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6ff8b352-0c05-4443-b77b-14cd5efa4c27 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:25.634Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:25.634Z InvocationID=755840ce-04da-47a0-843b-43a3430ed0e8 2021-07-13T00:37:25.923Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6ff8b352-0c05-4443-b77b-14cd5efa4c27 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:26.161Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6ff8b352-0c05-4443-b77b-14cd5efa4c27 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=527 EndTimestamp=2021-07-13T00:37:26.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:25.634Z InvocationID=653fa935-fcef-45ba-aa1e-0ee1ffe47567 ResponseDesc=OK 2021-07-13T00:37:27.417Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fc524abd-70df-42dc-95aa-d6fde58de1bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:27.416Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:27.416Z InvocationID=9a891148-c4a4-4305-a736-fbd2dce99d74 2021-07-13T00:37:27.438Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=98567eec-ed33-4149-8e99-8800e90b1e79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:27.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:27.438Z InvocationID=627aa9c0-66f2-4756-9021-c44e6deab01a 2021-07-13T00:37:28.659Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fc524abd-70df-42dc-95aa-d6fde58de1bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:28.711Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=98567eec-ed33-4149-8e99-8800e90b1e79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:28.873Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=319418d3-836a-460b-b445-e3ac30ad6146 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:28.873Z InvocationID=8776fb4f-c341-494f-9629-31f60554222d 2021-07-13T00:37:28.957Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fc524abd-70df-42dc-95aa-d6fde58de1bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1541 EndTimestamp=2021-07-13T00:37:28.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:27.416Z InvocationID=a91bcb2f-ef1b-4f0d-a56b-e18ed2355052 ResponseDesc=OK 2021-07-13T00:37:29.625Z [qtp817348612-65] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=319418d3-836a-460b-b445-e3ac30ad6146 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:31.762Z [qtp817348612-65] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=319418d3-836a-460b-b445-e3ac30ad6146 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2889 EndTimestamp=2021-07-13T00:37:31.762Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:28.873Z InvocationID=2ad02664-c2e2-4e0a-a386-ee2bdc6e7227 ResponseDesc=OK 2021-07-13T00:37:31.821Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a98ba4b3-0885-4221-96c4-7d484082b120 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:31.821Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:31.821Z InvocationID=00537c8f-46c3-413a-8538-006947429c67 2021-07-13T00:37:31.923Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=98567eec-ed33-4149-8e99-8800e90b1e79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4485 EndTimestamp=2021-07-13T00:37:31.923Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:27.438Z InvocationID=6dc5613c-903c-4c93-9e62-9638a6a22a1f ResponseDesc=OK 2021-07-13T00:37:31.956Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a98ba4b3-0885-4221-96c4-7d484082b120 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:32.357Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a98ba4b3-0885-4221-96c4-7d484082b120 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=536 EndTimestamp=2021-07-13T00:37:32.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:31.821Z InvocationID=bc38b4eb-b38a-4a82-ac81-a72ca2b20e40 ResponseDesc=OK 2021-07-13T00:37:34.217Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=99246e1d-f9a7-4d54-ba45-4473eb26c984 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:34.217Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:34.217Z InvocationID=d9f244df-669d-4791-8267-ade703d7e317 2021-07-13T00:37:34.259Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=99246e1d-f9a7-4d54-ba45-4473eb26c984 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:36.419Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=99246e1d-f9a7-4d54-ba45-4473eb26c984 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2202 EndTimestamp=2021-07-13T00:37:36.419Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:34.217Z InvocationID=66a15173-ee3a-4ae1-8ccc-5ae6a013f187 ResponseDesc=OK 2021-07-13T00:37:37.439Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ef03f5c2-0ec5-42ed-8fff-3fb7c5aaa5f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:37.439Z InvocationID=2419a612-660c-43dd-8749-69ef8a4a820f 2021-07-13T00:37:37.620Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ef03f5c2-0ec5-42ed-8fff-3fb7c5aaa5f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:37.671Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=38860470-f4f0-40e5-b039-b15be9ca82a3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:37.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:37.670Z InvocationID=7cf35ab0-0fb9-45b1-8f08-844fd6018ef2 2021-07-13T00:37:37.857Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=38860470-f4f0-40e5-b039-b15be9ca82a3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:37.873Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ef03f5c2-0ec5-42ed-8fff-3fb7c5aaa5f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=434 EndTimestamp=2021-07-13T00:37:37.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:37.439Z InvocationID=1f4bfbbf-f3a6-41cd-bc85-eec77b181c2a ResponseDesc=OK 2021-07-13T00:37:38.357Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=38860470-f4f0-40e5-b039-b15be9ca82a3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=687 EndTimestamp=2021-07-13T00:37:38.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:37.670Z InvocationID=7b08e2e9-6de0-41af-a41e-5f8fb19d8e2e ResponseDesc=OK 2021-07-13T00:37:38.873Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ebf6f712-d014-4206-b308-826f34c5fd7f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:38.873Z InvocationID=f556806b-73c6-4fa1-a03e-304cf1766e48 2021-07-13T00:37:38.960Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ebf6f712-d014-4206-b308-826f34c5fd7f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:39.426Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ebf6f712-d014-4206-b308-826f34c5fd7f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=553 EndTimestamp=2021-07-13T00:37:39.426Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:38.873Z InvocationID=aea227cd-8275-4e6a-8af2-add52f4849f7 ResponseDesc=OK 2021-07-13T00:37:40.161Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e174fe11-f94d-4adf-bf36-555865ad8bb7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:40.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:40.161Z InvocationID=44de88e4-e48f-4e8a-b52b-757e3990d883 2021-07-13T00:37:40.825Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e174fe11-f94d-4adf-bf36-555865ad8bb7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:41.060Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e174fe11-f94d-4adf-bf36-555865ad8bb7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=899 EndTimestamp=2021-07-13T00:37:41.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:40.161Z InvocationID=cf603734-c569-4780-bd46-69b0f4699e24 ResponseDesc=OK 2021-07-13T00:37:42.166Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2c154640-746c-4e6b-b235-1b3c313d5585 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:42.166Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:42.166Z InvocationID=9874bb0c-8bc1-4310-802f-bb118dd1fa2f 2021-07-13T00:37:42.356Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2c154640-746c-4e6b-b235-1b3c313d5585 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:42.559Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2c154640-746c-4e6b-b235-1b3c313d5585 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=393 EndTimestamp=2021-07-13T00:37:42.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:42.166Z InvocationID=d1e12fc8-f192-4d8a-9143-1d1951f81f75 ResponseDesc=OK 2021-07-13T00:37:43.466Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a6176f40-367f-4d14-89a7-8b51b01da892 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:43.466Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:43.466Z InvocationID=fee1dce7-be05-4c26-8c6a-08ee5a51baf7 2021-07-13T00:37:43.559Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a6176f40-367f-4d14-89a7-8b51b01da892 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:43.823Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a6176f40-367f-4d14-89a7-8b51b01da892 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=357 EndTimestamp=2021-07-13T00:37:43.823Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:43.466Z InvocationID=be4d32f4-6345-4d7b-89b4-adbda92e9d37 ResponseDesc=OK 2021-07-13T00:37:44.866Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=98f71030-c685-41cb-887a-c7ff01a5242d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:44.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:44.866Z InvocationID=fd102d84-c4d6-4994-9f53-36208d9c6366 2021-07-13T00:37:44.986Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=98f71030-c685-41cb-887a-c7ff01a5242d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:45.075Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=98f71030-c685-41cb-887a-c7ff01a5242d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=209 EndTimestamp=2021-07-13T00:37:45.075Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:44.866Z InvocationID=ccd327d2-efc4-44a8-8c5e-e3560ce7aec7 ResponseDesc=OK 2021-07-13T00:37:47.440Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=59432cf4-f1eb-4448-9de2-d093556a2947 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:47.440Z InvocationID=53d45cac-4f04-40d3-9f4c-5cdff3678a0e 2021-07-13T00:37:48.881Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=90369fe5-3139-4fef-ae7a-9288fefcd8eb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:48.881Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:48.881Z InvocationID=f371c806-3ccd-4481-8898-38feda0058f0 2021-07-13T00:37:51.058Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=59432cf4-f1eb-4448-9de2-d093556a2947 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:51.110Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=90369fe5-3139-4fef-ae7a-9288fefcd8eb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:51.257Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=59432cf4-f1eb-4448-9de2-d093556a2947 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3817 EndTimestamp=2021-07-13T00:37:51.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:47.440Z InvocationID=a329a360-a67a-49c6-9d27-06f04af6d9dd ResponseDesc=OK 2021-07-13T00:37:51.511Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=90369fe5-3139-4fef-ae7a-9288fefcd8eb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2630 EndTimestamp=2021-07-13T00:37:51.511Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:48.881Z InvocationID=36481694-08da-4f36-803d-c077a0fc8796 ResponseDesc=OK 2021-07-13T00:37:51.622Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c5795bcc-596e-4b22-b306-bee6aafef412 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:51.622Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:51.622Z InvocationID=ed710400-d391-4644-8578-1d69a63fe2ab 2021-07-13T00:37:51.815Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c5795bcc-596e-4b22-b306-bee6aafef412 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:51.964Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c5795bcc-596e-4b22-b306-bee6aafef412 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=342 EndTimestamp=2021-07-13T00:37:51.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:51.622Z InvocationID=1c7ebc58-f359-4dc8-bb3c-616c63e8fd22 ResponseDesc=OK 2021-07-13T00:37:52.974Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=46d6658e-5d86-44eb-92f3-f6ab3286cb2b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:52.973Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:52.973Z InvocationID=54031a36-54a7-4709-9c64-8da030343a62 2021-07-13T00:37:53.157Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=46d6658e-5d86-44eb-92f3-f6ab3286cb2b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:53.662Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=46d6658e-5d86-44eb-92f3-f6ab3286cb2b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=689 EndTimestamp=2021-07-13T00:37:53.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:52.973Z InvocationID=f78738c1-7549-415b-aca7-7bb2665d9959 ResponseDesc=OK 2021-07-13T00:37:54.563Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4165b3e7-dded-4683-94d0-4abd53426f9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:54.563Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:54.563Z InvocationID=88e923fa-d8bb-4d9b-ba5c-1f0d4552af3e 2021-07-13T00:37:54.659Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4165b3e7-dded-4683-94d0-4abd53426f9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:54.916Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4165b3e7-dded-4683-94d0-4abd53426f9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=353 EndTimestamp=2021-07-13T00:37:54.916Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:54.563Z InvocationID=dac36d98-7a10-4f9d-8880-6c22b70708e1 ResponseDesc=OK 2021-07-13T00:37:57.068Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5646998b-e086-4f6e-a6d1-ace3ee81ab49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:57.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:57.067Z InvocationID=65a4c01a-7229-4b1b-94c4-336f5ef20fc7 2021-07-13T00:37:57.439Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d6781c43-3ccf-4c2c-9a75-8db966d5deee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:57.439Z InvocationID=734b1e7f-2e3a-45af-8f51-0b80f19fc0cc 2021-07-13T00:37:57.511Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5646998b-e086-4f6e-a6d1-ace3ee81ab49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:57.559Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d6781c43-3ccf-4c2c-9a75-8db966d5deee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:57.858Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d6781c43-3ccf-4c2c-9a75-8db966d5deee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=419 EndTimestamp=2021-07-13T00:37:57.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:57.439Z InvocationID=6aeba49d-a1bb-4089-97fc-2d53ab3e0384 ResponseDesc=OK 2021-07-13T00:37:57.858Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5646998b-e086-4f6e-a6d1-ace3ee81ab49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=791 EndTimestamp=2021-07-13T00:37:57.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:57.067Z InvocationID=e749e46e-210f-4327-b516-82051a7864b1 ResponseDesc=OK 2021-07-13T00:37:58.873Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6e198522-e534-44db-bbfa-ed58739d6e56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:37:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:58.873Z InvocationID=c3ad7e3d-9ec1-42a9-be63-d71668c9ff3d 2021-07-13T00:37:59.059Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6e198522-e534-44db-bbfa-ed58739d6e56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:37:59.413Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6e198522-e534-44db-bbfa-ed58739d6e56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=540 EndTimestamp=2021-07-13T00:37:59.413Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:37:58.873Z InvocationID=950c143b-43ea-4162-be25-8178b4fe7460 ResponseDesc=OK 2021-07-13T00:38:00.070Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c9fbe5c5-2559-4de9-8145-4333bbbe4c84 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:00.070Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:00.070Z InvocationID=f7b19480-f7de-47a7-a727-2ff65dfd9247 2021-07-13T00:38:00.312Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c9fbe5c5-2559-4de9-8145-4333bbbe4c84 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:00.660Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c9fbe5c5-2559-4de9-8145-4333bbbe4c84 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=590 EndTimestamp=2021-07-13T00:38:00.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:00.070Z InvocationID=9d5516b5-d42b-46c6-b3e7-8dc7e4d87da4 ResponseDesc=OK 2021-07-13T00:38:02.864Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=80fde747-6cfd-4b89-833d-55ed9e56cfeb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:02.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:02.863Z InvocationID=b6367e2f-1a86-4018-a0e6-446cb71c220b 2021-07-13T00:38:03.057Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=80fde747-6cfd-4b89-833d-55ed9e56cfeb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:06.257Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=80fde747-6cfd-4b89-833d-55ed9e56cfeb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3394 EndTimestamp=2021-07-13T00:38:06.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:02.863Z InvocationID=59fa5d3c-5802-4fa6-8200-97832542dee7 ResponseDesc=OK 2021-07-13T00:38:07.303Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bda24e44-a5d7-4186-a8d4-ab0647aaf655 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:07.303Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:07.303Z InvocationID=ff27a2b3-6ede-47dc-8159-bab3bdcff7a5 2021-07-13T00:38:07.441Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ea874dc6-4dbc-46d7-8b5b-e03c5b61ac51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:07.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:07.441Z InvocationID=a38dc8a5-185e-4ed7-ab48-3c11ab43ec5f 2021-07-13T00:38:07.458Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bda24e44-a5d7-4186-a8d4-ab0647aaf655 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:07.558Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ea874dc6-4dbc-46d7-8b5b-e03c5b61ac51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:07.761Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ea874dc6-4dbc-46d7-8b5b-e03c5b61ac51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=320 EndTimestamp=2021-07-13T00:38:07.761Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:07.441Z InvocationID=bec56493-e2c1-4c25-ae52-3a6a6732fd4c ResponseDesc=OK 2021-07-13T00:38:07.767Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bda24e44-a5d7-4186-a8d4-ab0647aaf655 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=464 EndTimestamp=2021-07-13T00:38:07.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:07.303Z InvocationID=3d258717-3c8c-47f3-a3f0-c6f32da8ebc5 ResponseDesc=OK 2021-07-13T00:38:08.569Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=712fe1cd-8b45-4e5d-afe6-e8cbf8a9b26b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:08.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:08.569Z InvocationID=fe713b0f-98ce-45d4-9d31-562fa4573632 2021-07-13T00:38:08.873Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b581f73e-ae3b-45da-a8e0-92582db72f69 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:08.873Z InvocationID=af2880c9-7253-4c74-855e-f77f4d1a238b 2021-07-13T00:38:08.956Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=712fe1cd-8b45-4e5d-afe6-e8cbf8a9b26b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:09.558Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=712fe1cd-8b45-4e5d-afe6-e8cbf8a9b26b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=989 EndTimestamp=2021-07-13T00:38:09.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:08.569Z InvocationID=5422c4d2-80cf-4ea9-82f8-4a35079bd7e2 ResponseDesc=OK 2021-07-13T00:38:09.611Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b581f73e-ae3b-45da-a8e0-92582db72f69 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:10.313Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b581f73e-ae3b-45da-a8e0-92582db72f69 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1440 EndTimestamp=2021-07-13T00:38:10.313Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:08.873Z InvocationID=262356ef-7028-43ef-acec-13c19d64a374 ResponseDesc=OK 2021-07-13T00:38:11.866Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6d3b6e9c-dba8-4156-9eae-581a9e28c39a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:11.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:11.865Z InvocationID=ae4c7847-b237-46dc-a31c-f3238e8b555f 2021-07-13T00:38:12.123Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6d3b6e9c-dba8-4156-9eae-581a9e28c39a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:12.360Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6d3b6e9c-dba8-4156-9eae-581a9e28c39a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:38:12.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:11.865Z InvocationID=0ae97d08-6e21-4d8d-8548-06bb59f5cdd0 ResponseDesc=OK 2021-07-13T00:38:14.980Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=296777e7-989f-494c-939e-641d4b2b920e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:14.980Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:14.980Z InvocationID=c7243150-9e8f-444b-93a9-22fd7d996977 2021-07-13T00:38:15.157Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=296777e7-989f-494c-939e-641d4b2b920e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:15.857Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=296777e7-989f-494c-939e-641d4b2b920e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=877 EndTimestamp=2021-07-13T00:38:15.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:14.980Z InvocationID=6ab00e5b-0e6f-498b-9253-1124cba8941e ResponseDesc=OK 2021-07-13T00:38:17.444Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c51fec68-d784-4f9e-930f-20328ce04ea5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:17.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:17.444Z InvocationID=4cdacfc3-9e64-41d4-a9a6-4da84d47dd6f 2021-07-13T00:38:17.611Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c51fec68-d784-4f9e-930f-20328ce04ea5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:17.862Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=43acf74a-e3ce-44eb-b1ac-20db90da780e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:17.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:17.862Z InvocationID=4f3ea4f9-7dc7-4781-9a50-f63ebfd3047b 2021-07-13T00:38:18.620Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=43acf74a-e3ce-44eb-b1ac-20db90da780e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:18.623Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c51fec68-d784-4f9e-930f-20328ce04ea5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1179 EndTimestamp=2021-07-13T00:38:18.623Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:17.444Z InvocationID=d61c7bc2-e691-47de-ad7c-f879a09e8623 ResponseDesc=OK 2021-07-13T00:38:18.860Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=43acf74a-e3ce-44eb-b1ac-20db90da780e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=998 EndTimestamp=2021-07-13T00:38:18.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:17.862Z InvocationID=cfbd20c4-7fae-4492-b402-c22bcb5aa777 ResponseDesc=OK 2021-07-13T00:38:18.882Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8d25e2f1-131b-48f8-a1b0-3e675f74bfc2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:18.882Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:18.882Z InvocationID=e8dd5b7c-c683-4da1-896f-4466be6f8307 2021-07-13T00:38:19.156Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8d25e2f1-131b-48f8-a1b0-3e675f74bfc2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:20.657Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8d25e2f1-131b-48f8-a1b0-3e675f74bfc2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1775 EndTimestamp=2021-07-13T00:38:20.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:18.882Z InvocationID=dfa95956-fa09-40fa-8877-2fa43c243870 ResponseDesc=OK 2021-07-13T00:38:20.870Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1beac7d1-4c37-49f5-80ec-5f01b178c74e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:20.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:20.870Z InvocationID=0f1c8726-140b-4722-b022-0c43f6933243 2021-07-13T00:38:20.885Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1beac7d1-4c37-49f5-80ec-5f01b178c74e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:21.058Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1beac7d1-4c37-49f5-80ec-5f01b178c74e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=188 EndTimestamp=2021-07-13T00:38:21.058Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:20.870Z InvocationID=cbcb85c5-54e4-41c4-8e4c-7281a7086ea0 ResponseDesc=OK 2021-07-13T00:38:23.863Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=59cf9d8a-1827-4ccf-960b-8eb14d305799 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:23.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:23.863Z InvocationID=4e311c13-1562-41d7-943b-5e6d94df59f5 2021-07-13T00:38:24.012Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=59cf9d8a-1827-4ccf-960b-8eb14d305799 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:24.113Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=59cf9d8a-1827-4ccf-960b-8eb14d305799 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=250 EndTimestamp=2021-07-13T00:38:24.113Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:23.863Z InvocationID=96e15a77-6bd5-440e-89ab-9b541f9000ba ResponseDesc=OK 2021-07-13T00:38:26.565Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bdeea64a-ca63-4dc1-a6d2-87262cc7dc1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:26.565Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:26.565Z InvocationID=5c901b09-e6ea-4715-bd6e-b927b70b0cde 2021-07-13T00:38:26.757Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bdeea64a-ca63-4dc1-a6d2-87262cc7dc1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:27.359Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bdeea64a-ca63-4dc1-a6d2-87262cc7dc1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=794 EndTimestamp=2021-07-13T00:38:27.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:26.565Z InvocationID=89778438-3806-4908-b6ec-eebc925ac603 ResponseDesc=OK 2021-07-13T00:38:27.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5186cd06-a8c0-47ae-a814-b28724001dde InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:27.439Z InvocationID=ab5e8263-ebc3-424e-8c83-fa47de9f2ae9 2021-07-13T00:38:27.762Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5186cd06-a8c0-47ae-a814-b28724001dde InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:28.112Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5186cd06-a8c0-47ae-a814-b28724001dde InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=672 EndTimestamp=2021-07-13T00:38:28.111Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:27.439Z InvocationID=db6d27c6-52d4-44cd-b530-f59ec21114db ResponseDesc=OK 2021-07-13T00:38:28.873Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=30fef4b6-8dc3-428b-82b7-c55a1f6fc972 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:28.873Z InvocationID=6d91ffbe-d902-4712-b8ee-2e2f50d0ef5f 2021-07-13T00:38:29.115Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=30fef4b6-8dc3-428b-82b7-c55a1f6fc972 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:29.360Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=30fef4b6-8dc3-428b-82b7-c55a1f6fc972 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=487 EndTimestamp=2021-07-13T00:38:29.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:28.873Z InvocationID=33f58d59-7215-4dad-9ff2-0dab75789697 ResponseDesc=OK 2021-07-13T00:38:29.775Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c69f5722-9e5c-48cc-8754-db33dbfd134b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:29.775Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:29.775Z InvocationID=36fe72d9-d729-4284-a85f-1e4d2f5d91ba 2021-07-13T00:38:29.956Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c69f5722-9e5c-48cc-8754-db33dbfd134b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:30.357Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c69f5722-9e5c-48cc-8754-db33dbfd134b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=582 EndTimestamp=2021-07-13T00:38:30.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:29.775Z InvocationID=54f0df68-9569-4752-a893-9ea7242ea0c9 ResponseDesc=OK 2021-07-13T00:38:32.970Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=720d34c0-6e87-4497-b766-0a366fd40748 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:32.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:32.970Z InvocationID=7d6369e3-4d8f-4fbb-96c4-8388b7d4e4a2 2021-07-13T00:38:33.060Z [qtp817348612-64] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=720d34c0-6e87-4497-b766-0a366fd40748 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:33.415Z [qtp817348612-64] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=720d34c0-6e87-4497-b766-0a366fd40748 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=445 EndTimestamp=2021-07-13T00:38:33.415Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:32.970Z InvocationID=654297cf-e55c-432c-87a6-04f174d8af28 ResponseDesc=OK 2021-07-13T00:38:35.885Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fe0eba6d-ba48-4cea-9472-89c01000812f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:35.884Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:35.884Z InvocationID=7437d5ca-b674-41e9-acd0-1963941b7e66 2021-07-13T00:38:36.515Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fe0eba6d-ba48-4cea-9472-89c01000812f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:36.759Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fe0eba6d-ba48-4cea-9472-89c01000812f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=875 EndTimestamp=2021-07-13T00:38:36.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:35.884Z InvocationID=b4306651-a784-4d64-bbc2-011445bc4de2 ResponseDesc=OK 2021-07-13T00:38:37.440Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4e6ed906-d0a1-4158-a19d-2b042f3e7405 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:37.440Z InvocationID=da177986-749d-4c1a-8697-156b600f562a 2021-07-13T00:38:37.557Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4e6ed906-d0a1-4158-a19d-2b042f3e7405 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:38.158Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4e6ed906-d0a1-4158-a19d-2b042f3e7405 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=718 EndTimestamp=2021-07-13T00:38:38.158Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:37.440Z InvocationID=ce94c472-7583-45dc-ac1f-99afccc56173 ResponseDesc=OK 2021-07-13T00:38:38.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7e759540-ced2-4ea2-982e-a62bf18aa475 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:38.873Z InvocationID=a287a9f7-0bd1-4d27-9463-dfedc38505e6 2021-07-13T00:38:38.975Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7e759540-ced2-4ea2-982e-a62bf18aa475 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:39.272Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=80a24dcd-4e79-4ab4-ba17-01c9c88ff1d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:39.272Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:39.272Z InvocationID=6c3a862d-253a-40a6-bd08-dc49df8c5467 2021-07-13T00:38:40.218Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=80a24dcd-4e79-4ab4-ba17-01c9c88ff1d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:40.218Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7e759540-ced2-4ea2-982e-a62bf18aa475 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1345 EndTimestamp=2021-07-13T00:38:40.218Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:38.873Z InvocationID=61e7a3b1-7eb4-4b18-8d26-6ba47e6cc5dc ResponseDesc=OK 2021-07-13T00:38:40.459Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=80a24dcd-4e79-4ab4-ba17-01c9c88ff1d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1187 EndTimestamp=2021-07-13T00:38:40.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:39.272Z InvocationID=52e0b0ea-13b5-4e1f-a109-01e76eac4e95 ResponseDesc=OK 2021-07-13T00:38:42.063Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=554db0da-bc1c-40a9-b587-62b99756db67 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:42.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:42.063Z InvocationID=4e56b1bf-6bf2-4634-acb0-eb601b8eaa2b 2021-07-13T00:38:42.161Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=554db0da-bc1c-40a9-b587-62b99756db67 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:42.858Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=554db0da-bc1c-40a9-b587-62b99756db67 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=795 EndTimestamp=2021-07-13T00:38:42.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:42.063Z InvocationID=9873de04-9940-4e30-9dd0-4fb688105a9c ResponseDesc=OK 2021-07-13T00:38:45.071Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=18ddd86e-621a-46fb-8a91-8c2fb8a715bc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:45.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:45.071Z InvocationID=c3405f43-40b2-44eb-8c36-4fc40a8e896c 2021-07-13T00:38:45.170Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=18ddd86e-621a-46fb-8a91-8c2fb8a715bc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:45.724Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=18ddd86e-621a-46fb-8a91-8c2fb8a715bc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=653 EndTimestamp=2021-07-13T00:38:45.724Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:45.071Z InvocationID=40f15ba3-2973-47b3-995a-cc298ecef584 ResponseDesc=OK 2021-07-13T00:38:47.441Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c0e81e11-5ce2-4a66-9cc3-8288e78d8a64 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:47.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:47.441Z InvocationID=f3de3023-4571-44ed-9fff-76aa53167b95 2021-07-13T00:38:47.618Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c0e81e11-5ce2-4a66-9cc3-8288e78d8a64 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:47.861Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c0e81e11-5ce2-4a66-9cc3-8288e78d8a64 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=420 EndTimestamp=2021-07-13T00:38:47.861Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:47.441Z InvocationID=90f067b1-4de4-4ff0-8a9a-99d024a21d02 ResponseDesc=OK 2021-07-13T00:38:47.869Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d0dc2b1c-52fd-4c3f-b13c-a73a65f3a0f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:47.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:47.869Z InvocationID=a2ff01f3-ad3c-4622-8504-152b832d2bfb 2021-07-13T00:38:48.057Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d0dc2b1c-52fd-4c3f-b13c-a73a65f3a0f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:48.459Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d0dc2b1c-52fd-4c3f-b13c-a73a65f3a0f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=590 EndTimestamp=2021-07-13T00:38:48.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:47.869Z InvocationID=2368abb2-b640-40b9-869f-df2a38b3c075 ResponseDesc=OK 2021-07-13T00:38:48.875Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=544bbb5e-15f0-4e5d-8937-a7b6e721a94e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:48.874Z InvocationID=402f3044-9ac9-41df-9799-fb45e69c837f 2021-07-13T00:38:49.159Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=544bbb5e-15f0-4e5d-8937-a7b6e721a94e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:49.612Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=544bbb5e-15f0-4e5d-8937-a7b6e721a94e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=737 EndTimestamp=2021-07-13T00:38:49.611Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:48.874Z InvocationID=e52bb105-6d42-4649-a8a0-970a12e1506e ResponseDesc=OK 2021-07-13T00:38:51.069Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9655d71b-9264-4d0c-8343-363f1cc33f12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:51.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:51.069Z InvocationID=fc730017-0b2d-4cab-9d47-90b872abe314 2021-07-13T00:38:52.176Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9655d71b-9264-4d0c-8343-363f1cc33f12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:52.267Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9655d71b-9264-4d0c-8343-363f1cc33f12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1198 EndTimestamp=2021-07-13T00:38:52.267Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:51.069Z InvocationID=392f7535-9941-4740-a2bd-d4bd903d4aa4 ResponseDesc=OK 2021-07-13T00:38:57.138Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=65064246-cfae-4cf4-92a0-2eeee466e241 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:57.137Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:57.137Z InvocationID=726c3195-693d-4082-8587-e929d270a67d 2021-07-13T00:38:57.444Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1d1b0da0-715e-46e5-9d5b-ba7d438e7f6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:57.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:57.444Z InvocationID=e0d77bc2-02b7-4fde-9dc9-b74f0f0a7b10 2021-07-13T00:38:57.956Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=65064246-cfae-4cf4-92a0-2eeee466e241 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:58.190Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1d1b0da0-715e-46e5-9d5b-ba7d438e7f6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:58.359Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=65064246-cfae-4cf4-92a0-2eeee466e241 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1222 EndTimestamp=2021-07-13T00:38:58.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:57.137Z InvocationID=500e00b8-657a-4508-b97a-77a59b0da2e7 ResponseDesc=OK 2021-07-13T00:38:58.875Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bec94347-3cd0-4df5-baa8-68f755d1dfa8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:58.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:58.875Z InvocationID=071c0205-6b39-4dfa-a2cc-8f4eaeab9c62 2021-07-13T00:38:59.115Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1d1b0da0-715e-46e5-9d5b-ba7d438e7f6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1671 EndTimestamp=2021-07-13T00:38:59.115Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:57.444Z InvocationID=26dd7f93-e034-469e-9f70-a2817c39d5da ResponseDesc=OK 2021-07-13T00:38:59.265Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=45281718-5b9f-41e1-a331-a9b5bc288509 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:38:59.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:59.265Z InvocationID=46c55322-90b3-4881-82e0-e4754d637efd 2021-07-13T00:38:59.560Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=45281718-5b9f-41e1-a331-a9b5bc288509 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:59.774Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bec94347-3cd0-4df5-baa8-68f755d1dfa8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:38:59.777Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=45281718-5b9f-41e1-a331-a9b5bc288509 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=511 EndTimestamp=2021-07-13T00:38:59.776Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:59.265Z InvocationID=c7473ee9-8a63-4e8b-8501-52446ac876b7 ResponseDesc=OK 2021-07-13T00:39:00.057Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bec94347-3cd0-4df5-baa8-68f755d1dfa8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1182 EndTimestamp=2021-07-13T00:39:00.057Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:38:58.875Z InvocationID=b1a4613d-7ea0-4915-bbea-05f9ec741712 ResponseDesc=OK 2021-07-13T00:39:00.863Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4fd62472-716c-400e-b573-c66a46644c4e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:00.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:00.863Z InvocationID=09bc16e1-8d4e-4082-be65-6b7d09ef76f0 2021-07-13T00:39:00.961Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4fd62472-716c-400e-b573-c66a46644c4e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:01.515Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4fd62472-716c-400e-b573-c66a46644c4e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=652 EndTimestamp=2021-07-13T00:39:01.515Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:00.863Z InvocationID=b294b5dd-49bc-48aa-831d-04e0d2c3f3e9 ResponseDesc=OK 2021-07-13T00:39:02.563Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8af2d20b-2fb0-4f7e-b610-4f19ba676901 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:02.563Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:02.563Z InvocationID=5c2431e6-b9cf-4ee3-8e52-cc5d033015a3 2021-07-13T00:39:02.721Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8af2d20b-2fb0-4f7e-b610-4f19ba676901 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:02.912Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8af2d20b-2fb0-4f7e-b610-4f19ba676901 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=349 EndTimestamp=2021-07-13T00:39:02.912Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:02.563Z InvocationID=f1e1a366-5d3c-47da-a195-d5f07f1540d3 ResponseDesc=OK 2021-07-13T00:39:05.961Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8c1ad737-608f-43c9-9cdc-5474d03406a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:05.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:05.960Z InvocationID=2c98d8dc-ce96-46c9-88e7-04910e7a07b5 2021-07-13T00:39:06.056Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8c1ad737-608f-43c9-9cdc-5474d03406a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:06.457Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8c1ad737-608f-43c9-9cdc-5474d03406a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=497 EndTimestamp=2021-07-13T00:39:06.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:05.960Z InvocationID=0092124d-e846-455f-a669-b0dd62bde5df ResponseDesc=OK 2021-07-13T00:39:07.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=91054fb1-ffdc-4aab-bce7-53680b2ee471 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:07.439Z InvocationID=557fee7b-4301-4a2d-82f0-39fdd1b0d8fc 2021-07-13T00:39:07.559Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=91054fb1-ffdc-4aab-bce7-53680b2ee471 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:07.912Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=91054fb1-ffdc-4aab-bce7-53680b2ee471 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=473 EndTimestamp=2021-07-13T00:39:07.912Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:07.439Z InvocationID=63e4baeb-617c-4f8e-aa8c-23dbbb73997c ResponseDesc=OK 2021-07-13T00:39:08.762Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=747398e0-83c2-43b3-9db9-bf1a416e053d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:08.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:08.761Z InvocationID=9fe07cf4-5069-4feb-bdc4-0f6e21aac633 2021-07-13T00:39:08.873Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=89b0e873-36c7-48ca-96c9-1da3f4e74510 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:08.873Z InvocationID=394f77b0-56ca-479b-bdf7-b501f3a83b53 2021-07-13T00:39:08.962Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=89b0e873-36c7-48ca-96c9-1da3f4e74510 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:08.982Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=747398e0-83c2-43b3-9db9-bf1a416e053d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:09.259Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=89b0e873-36c7-48ca-96c9-1da3f4e74510 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=386 EndTimestamp=2021-07-13T00:39:09.259Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:08.873Z InvocationID=a9bfb28e-a639-4f2b-b09e-0728f386369c ResponseDesc=OK 2021-07-13T00:39:09.357Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=747398e0-83c2-43b3-9db9-bf1a416e053d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=596 EndTimestamp=2021-07-13T00:39:09.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:08.761Z InvocationID=89a505ae-046e-45b3-bc8c-b505ef3acff9 ResponseDesc=OK 2021-07-13T00:39:11.961Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8f633b0b-dfad-4bfc-b832-aa870f0abacc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:11.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:11.961Z InvocationID=f92a58ad-c920-4b67-b024-ad4436a9de3c 2021-07-13T00:39:12.059Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8f633b0b-dfad-4bfc-b832-aa870f0abacc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:12.315Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8f633b0b-dfad-4bfc-b832-aa870f0abacc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=354 EndTimestamp=2021-07-13T00:39:12.315Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:11.961Z InvocationID=d10429c5-c530-43cb-bb76-ba4d77fbac52 ResponseDesc=OK 2021-07-13T00:39:14.962Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=785600df-5dd4-458e-a14d-01578fc96e1d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:14.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:14.962Z InvocationID=ccf3638c-0cbf-4410-867f-c2f055cf2c47 2021-07-13T00:39:15.514Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=785600df-5dd4-458e-a14d-01578fc96e1d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:15.759Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=785600df-5dd4-458e-a14d-01578fc96e1d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=797 EndTimestamp=2021-07-13T00:39:15.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:14.962Z InvocationID=02c31983-4727-42dc-b606-923ec6e05dca ResponseDesc=OK 2021-07-13T00:39:17.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=363071b8-e5a8-4516-a45d-d28fd5a3990e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:17.439Z InvocationID=8a31a95d-5095-4ee7-88c5-12c21d89969b 2021-07-13T00:39:17.558Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=363071b8-e5a8-4516-a45d-d28fd5a3990e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:18.563Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=62cb8c95-485c-4781-87c6-24b712ccc4fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:18.563Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:18.563Z InvocationID=ce526381-0f5a-41ab-96bd-ba503b687f1e 2021-07-13T00:39:18.874Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=56654028-6968-46c3-8ab2-5ddfcad116a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:18.874Z InvocationID=d185cc0a-8b75-4320-ad90-b1322e6bf838 2021-07-13T00:39:19.057Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=56654028-6968-46c3-8ab2-5ddfcad116a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:19.160Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=62cb8c95-485c-4781-87c6-24b712ccc4fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:19.357Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=363071b8-e5a8-4516-a45d-d28fd5a3990e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1918 EndTimestamp=2021-07-13T00:39:19.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:17.439Z InvocationID=6065c863-5c2d-4084-a206-8db63be25165 ResponseDesc=OK 2021-07-13T00:39:19.459Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=56654028-6968-46c3-8ab2-5ddfcad116a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=585 EndTimestamp=2021-07-13T00:39:19.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:18.874Z InvocationID=03ed422b-8864-4841-9de5-9710d12f35aa ResponseDesc=OK 2021-07-13T00:39:19.639Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=62cb8c95-485c-4781-87c6-24b712ccc4fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1075 EndTimestamp=2021-07-13T00:39:19.638Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:18.563Z InvocationID=1f884b04-0187-40bb-a53d-4674d49d882f ResponseDesc=OK 2021-07-13T00:39:20.661Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be02cb04-1264-46e0-ac60-b605fde61e43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:20.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:20.661Z InvocationID=04e6b3f6-547c-4c22-8f6c-f1954c1507fe 2021-07-13T00:39:23.960Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be02cb04-1264-46e0-ac60-b605fde61e43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:24.257Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be02cb04-1264-46e0-ac60-b605fde61e43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3596 EndTimestamp=2021-07-13T00:39:24.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:20.661Z InvocationID=a11e619b-423f-4df1-9631-be0cb9f10d1e ResponseDesc=OK 2021-07-13T00:39:24.576Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be5de8df-1790-4c89-b365-a15b295ecbf9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:24.576Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:24.576Z InvocationID=e0d68749-6947-42dd-98b1-557b0291104a 2021-07-13T00:39:24.668Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be5de8df-1790-4c89-b365-a15b295ecbf9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:25.016Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be5de8df-1790-4c89-b365-a15b295ecbf9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:39:25.015Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:24.576Z InvocationID=9cbeb882-68be-4a51-95c6-1d86dfa28e9f ResponseDesc=OK 2021-07-13T00:39:27.163Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1e175b44-b257-45bc-853c-cef25264edb0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:27.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:27.163Z InvocationID=f902977b-2b9c-498b-aa98-f38ed9386e13 2021-07-13T00:39:27.418Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1e175b44-b257-45bc-853c-cef25264edb0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:27.441Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=160ee12f-2b0f-473b-8971-5c0371e74370 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:27.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:27.441Z InvocationID=bea6074f-c989-43c4-a713-84eaaab237a5 2021-07-13T00:39:27.656Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=160ee12f-2b0f-473b-8971-5c0371e74370 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:27.660Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1e175b44-b257-45bc-853c-cef25264edb0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=497 EndTimestamp=2021-07-13T00:39:27.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:27.163Z InvocationID=c9c02401-2aeb-438a-a90a-e9ea286048e2 ResponseDesc=OK 2021-07-13T00:39:28.057Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=160ee12f-2b0f-473b-8971-5c0371e74370 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=616 EndTimestamp=2021-07-13T00:39:28.057Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:27.441Z InvocationID=015239a2-d85b-4313-95cd-35cbabebc451 ResponseDesc=OK 2021-07-13T00:39:28.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b2d5ad43-1f84-4e11-a0bc-4ceb939d5b79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:28.873Z InvocationID=efcee2d5-2b0b-4165-bc4e-10a54b25248a 2021-07-13T00:39:28.966Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b2d5ad43-1f84-4e11-a0bc-4ceb939d5b79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:29.616Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b2d5ad43-1f84-4e11-a0bc-4ceb939d5b79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=743 EndTimestamp=2021-07-13T00:39:29.616Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:28.873Z InvocationID=78b0e50b-051d-4c73-82ed-359719d79798 ResponseDesc=OK 2021-07-13T00:39:30.316Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=64446ed4-6483-4fd6-a494-66894f63f0fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:30.315Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:30.315Z InvocationID=f3eb447f-3213-429f-8083-66a8b1bf6f54 2021-07-13T00:39:30.679Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=64446ed4-6483-4fd6-a494-66894f63f0fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:30.960Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=64446ed4-6483-4fd6-a494-66894f63f0fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=644 EndTimestamp=2021-07-13T00:39:30.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:30.315Z InvocationID=bb7aae40-03fd-4068-862d-86867c561ab8 ResponseDesc=OK 2021-07-13T00:39:32.867Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=913d20fa-3381-4ef0-b3bf-e1ea1a9066aa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:32.867Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:32.867Z InvocationID=70831615-25a9-42b5-a55f-43e1fecd6f21 2021-07-13T00:39:33.156Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=913d20fa-3381-4ef0-b3bf-e1ea1a9066aa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:33.276Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=913d20fa-3381-4ef0-b3bf-e1ea1a9066aa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=409 EndTimestamp=2021-07-13T00:39:33.276Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:32.867Z InvocationID=2a33c78f-3ebf-4bb9-9023-61739bb46ae2 ResponseDesc=OK 2021-07-13T00:39:35.822Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f29638e2-e7ce-412f-a3bb-f81312b14236 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:35.822Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:35.822Z InvocationID=6d6f420e-3db7-466a-bf6f-d19b2df1dd77 2021-07-13T00:39:35.961Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f29638e2-e7ce-412f-a3bb-f81312b14236 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:36.312Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f29638e2-e7ce-412f-a3bb-f81312b14236 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=490 EndTimestamp=2021-07-13T00:39:36.312Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:35.822Z InvocationID=e8db2fa6-0838-4044-a142-927e9cf7fc08 ResponseDesc=OK 2021-07-13T00:39:37.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d1b64c71-2e82-46d3-ab01-86bcf5ff96ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:37.439Z InvocationID=552ebe91-3159-47fa-a849-c86c23a0657c 2021-07-13T00:39:37.566Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d1b64c71-2e82-46d3-ab01-86bcf5ff96ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:37.668Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d1b64c71-2e82-46d3-ab01-86bcf5ff96ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=229 EndTimestamp=2021-07-13T00:39:37.668Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:37.439Z InvocationID=c848aa12-2536-4b1f-b7e8-c0951ac8532a ResponseDesc=OK 2021-07-13T00:39:38.875Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6518b788-e4d6-4d83-86e5-105abaa727f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:38.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:38.875Z InvocationID=eab003d4-d420-44a4-8b74-f0f355a8248f 2021-07-13T00:39:38.963Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6518b788-e4d6-4d83-86e5-105abaa727f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:39.060Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ac6a0897-3271-4175-bf51-62aa65411053 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:39.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:39.060Z InvocationID=a6e55645-2586-4f56-8d3f-ad2da6d6290c 2021-07-13T00:39:39.075Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ac6a0897-3271-4175-bf51-62aa65411053 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:39.169Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6518b788-e4d6-4d83-86e5-105abaa727f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=294 EndTimestamp=2021-07-13T00:39:39.169Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:38.875Z InvocationID=e8386a2a-2797-47bf-8b11-08e6b1af0216 ResponseDesc=OK 2021-07-13T00:39:39.572Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ac6a0897-3271-4175-bf51-62aa65411053 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=512 EndTimestamp=2021-07-13T00:39:39.572Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:39.060Z InvocationID=b8a429fb-146e-46a3-9f67-b3c12f42ea98 ResponseDesc=OK 2021-07-13T00:39:41.962Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8ab94e93-00c1-4607-bda9-a4b66f20454b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:41.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:41.962Z InvocationID=da4d6bb4-c285-4777-8f1f-246d8a0c6e9a 2021-07-13T00:39:42.178Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8ab94e93-00c1-4607-bda9-a4b66f20454b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:44.158Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8ab94e93-00c1-4607-bda9-a4b66f20454b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2196 EndTimestamp=2021-07-13T00:39:44.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:41.962Z InvocationID=63a5eefd-0d2e-43bb-8d73-0dff37501086 ResponseDesc=OK 2021-07-13T00:39:45.273Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e9e82bb2-f25f-4b5c-a86f-029c97338fec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:45.272Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:45.272Z InvocationID=00475f31-15d6-4143-b2a6-ec4af0f6d1b2 2021-07-13T00:39:45.456Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e9e82bb2-f25f-4b5c-a86f-029c97338fec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:45.671Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e9e82bb2-f25f-4b5c-a86f-029c97338fec InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=399 EndTimestamp=2021-07-13T00:39:45.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:45.272Z InvocationID=558eab7c-0118-4101-bbbf-980356ee9538 ResponseDesc=OK 2021-07-13T00:39:47.439Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=72b8d9f3-b028-4f41-a7ef-24b7e921dff7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:47.439Z InvocationID=f3c8cab0-c00d-4f82-9b17-52775b375937 2021-07-13T00:39:47.467Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=72b8d9f3-b028-4f41-a7ef-24b7e921dff7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:47.661Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=72b8d9f3-b028-4f41-a7ef-24b7e921dff7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=222 EndTimestamp=2021-07-13T00:39:47.661Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:47.439Z InvocationID=78888f07-58e0-443d-995c-e47f75b3c0d3 ResponseDesc=OK 2021-07-13T00:39:47.871Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0475ec29-488e-4478-9961-b77cdaa76acb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:47.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:47.871Z InvocationID=908e76b8-d1de-4414-ab19-0e2df31181ea 2021-07-13T00:39:47.965Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0475ec29-488e-4478-9961-b77cdaa76acb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:48.161Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0475ec29-488e-4478-9961-b77cdaa76acb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=289 EndTimestamp=2021-07-13T00:39:48.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:47.871Z InvocationID=b96851dd-b0a5-4dd6-bd44-34ba99c334db ResponseDesc=OK 2021-07-13T00:39:48.873Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6011978d-4290-4e1f-a32c-726177c23546 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:48.873Z InvocationID=7dc849f5-378d-45c2-ad24-763bc8d40f23 2021-07-13T00:39:48.964Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6011978d-4290-4e1f-a32c-726177c23546 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:49.164Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6011978d-4290-4e1f-a32c-726177c23546 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=291 EndTimestamp=2021-07-13T00:39:49.164Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:48.873Z InvocationID=3f9f1da9-d222-4c03-a72d-cd03ec604dd4 ResponseDesc=OK 2021-07-13T00:39:51.168Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f19ed08a-a56a-4dd7-8fdd-10e9da6b8cbd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:51.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:51.168Z InvocationID=66805b0d-b9b2-4bf6-baa5-53cd46f38c71 2021-07-13T00:39:51.260Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f19ed08a-a56a-4dd7-8fdd-10e9da6b8cbd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:51.524Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f19ed08a-a56a-4dd7-8fdd-10e9da6b8cbd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=356 EndTimestamp=2021-07-13T00:39:51.524Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:51.168Z InvocationID=6ca4a582-3d17-44e4-9c6d-b633f0b26f35 ResponseDesc=OK 2021-07-13T00:39:54.075Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=47fc6a3d-625e-49aa-8e31-7f4dce55f3e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:54.075Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:54.075Z InvocationID=927eb736-05fc-43d9-b111-1fbbc07ceb2f 2021-07-13T00:39:54.167Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=47fc6a3d-625e-49aa-8e31-7f4dce55f3e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:54.258Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=47fc6a3d-625e-49aa-8e31-7f4dce55f3e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=183 EndTimestamp=2021-07-13T00:39:54.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:54.075Z InvocationID=100d701d-35c5-4831-93ab-ad0fdf8eb509 ResponseDesc=OK 2021-07-13T00:39:56.767Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=68f36bef-e926-4f1c-8fd8-5a5eefac276f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:56.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:56.767Z InvocationID=699f4fc6-8626-42a1-a152-8f2c6e57df9b 2021-07-13T00:39:56.871Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=68f36bef-e926-4f1c-8fd8-5a5eefac276f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:57.160Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=68f36bef-e926-4f1c-8fd8-5a5eefac276f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=393 EndTimestamp=2021-07-13T00:39:57.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:56.767Z InvocationID=a89a28dc-fef0-47e1-9a08-fd5e17070f23 ResponseDesc=OK 2021-07-13T00:39:57.440Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=06b05bd0-33d3-4ed4-bcf8-eb201b51390a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:57.440Z InvocationID=2893d075-e195-4a8d-ac66-42c1aaf78de3 2021-07-13T00:39:57.559Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=06b05bd0-33d3-4ed4-bcf8-eb201b51390a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:57.690Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=06b05bd0-33d3-4ed4-bcf8-eb201b51390a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=249 EndTimestamp=2021-07-13T00:39:57.689Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:57.440Z InvocationID=c6ffb45b-c1c4-41c1-9ba5-004d7228732f ResponseDesc=OK 2021-07-13T00:39:58.875Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=19b89761-0565-4dff-94e1-1e199f2b8316 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:58.874Z InvocationID=50f8f147-764e-40d7-8df4-b845b35c2f57 2021-07-13T00:39:59.111Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=19b89761-0565-4dff-94e1-1e199f2b8316 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:39:59.260Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=19b89761-0565-4dff-94e1-1e199f2b8316 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=386 EndTimestamp=2021-07-13T00:39:59.260Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:58.874Z InvocationID=ee7f5e9e-c58c-453b-a6c8-d2c23cf19385 ResponseDesc=OK 2021-07-13T00:39:59.974Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e239e666-12fa-4dfc-b763-47bb9bad4576 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:39:59.974Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:59.974Z InvocationID=677cf421-925d-4baf-b720-aa27381450b1 2021-07-13T00:40:00.157Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e239e666-12fa-4dfc-b763-47bb9bad4576 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:00.358Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e239e666-12fa-4dfc-b763-47bb9bad4576 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=384 EndTimestamp=2021-07-13T00:40:00.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:39:59.974Z InvocationID=d672e8dc-6c34-46bd-956a-00571d8ea45d ResponseDesc=OK 2021-07-13T00:40:03.068Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cdab293d-64e7-431f-aade-d43121bddb0c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:03.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:03.068Z InvocationID=4d484adf-a0be-4c99-b85c-f0910ce813f0 2021-07-13T00:40:03.159Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cdab293d-64e7-431f-aade-d43121bddb0c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:03.516Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cdab293d-64e7-431f-aade-d43121bddb0c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=448 EndTimestamp=2021-07-13T00:40:03.516Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:03.068Z InvocationID=0ede8b01-915b-4ab3-9e0c-64b91912211b ResponseDesc=OK 2021-07-13T00:40:05.885Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8cda0c70-6457-468f-986d-6b60dbd04572 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:05.885Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:05.885Z InvocationID=bbe4ccb0-a473-4062-b7fa-3edecf3eb8ea 2021-07-13T00:40:07.014Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8cda0c70-6457-468f-986d-6b60dbd04572 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:07.212Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8cda0c70-6457-468f-986d-6b60dbd04572 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1326 EndTimestamp=2021-07-13T00:40:07.211Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:05.885Z InvocationID=c3ecccef-b452-48d8-b35b-b8b65550d4c9 ResponseDesc=OK 2021-07-13T00:40:07.442Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=212e05eb-8551-4e9a-80e5-f3c1fe8eed06 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:07.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:07.442Z InvocationID=e8b928ef-6603-47e6-b926-5827875d74e0 2021-07-13T00:40:07.656Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=212e05eb-8551-4e9a-80e5-f3c1fe8eed06 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:07.965Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=212e05eb-8551-4e9a-80e5-f3c1fe8eed06 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=523 EndTimestamp=2021-07-13T00:40:07.965Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:07.442Z InvocationID=3a059c76-ea0b-4f00-9c0e-28d32dc75de1 ResponseDesc=OK 2021-07-13T00:40:08.874Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f6b95eb0-2981-4298-89af-177bf93e45b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:08.874Z InvocationID=58fef133-7ceb-482f-ae22-5cb460611c3e 2021-07-13T00:40:09.061Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f6b95eb0-2981-4298-89af-177bf93e45b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:09.421Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f6b95eb0-2981-4298-89af-177bf93e45b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=547 EndTimestamp=2021-07-13T00:40:09.421Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:08.874Z InvocationID=016258be-ac43-468a-8656-9eae488f758c ResponseDesc=OK 2021-07-13T00:40:09.828Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e59a1169-fad5-45af-9a6e-d13afaf415f3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:09.828Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:09.828Z InvocationID=602839f6-9743-430e-8301-ffb4ed5d45e6 2021-07-13T00:40:10.023Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e59a1169-fad5-45af-9a6e-d13afaf415f3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:10.263Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e59a1169-fad5-45af-9a6e-d13afaf415f3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=435 EndTimestamp=2021-07-13T00:40:10.263Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:09.828Z InvocationID=34e63654-3a86-4f26-8255-63e62915bb8e ResponseDesc=OK 2021-07-13T00:40:11.962Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=098c0c05-ced7-497a-aba5-33a89c639e9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:11.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:11.962Z InvocationID=61c6c433-a96a-4c84-961a-d5cf22f2231d 2021-07-13T00:40:12.068Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=098c0c05-ced7-497a-aba5-33a89c639e9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:12.559Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=098c0c05-ced7-497a-aba5-33a89c639e9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=597 EndTimestamp=2021-07-13T00:40:12.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:11.962Z InvocationID=bc088314-4784-4b73-900a-3b69b8a28d3e ResponseDesc=OK 2021-07-13T00:40:14.963Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=40ec8fce-4a6d-4051-a9ca-0158cfb997b5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:14.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:14.963Z InvocationID=54ca4536-d1f7-4525-88ab-258334f01911 2021-07-13T00:40:15.059Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=40ec8fce-4a6d-4051-a9ca-0158cfb997b5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:16.187Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=40ec8fce-4a6d-4051-a9ca-0158cfb997b5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1224 EndTimestamp=2021-07-13T00:40:16.187Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:14.963Z InvocationID=0bd8cd76-8e5e-4432-8274-b4754bc18fb8 ResponseDesc=OK 2021-07-13T00:40:17.442Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=faaa80ed-00d4-4a8d-bc2e-f4ad4805e5fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:17.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:17.442Z InvocationID=a5b9fd61-452c-489c-a75f-2e5e527932d7 2021-07-13T00:40:18.215Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=faaa80ed-00d4-4a8d-bc2e-f4ad4805e5fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:18.217Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f741de33-daa0-4b47-a94f-1a039b1d1bf7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:18.217Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:18.217Z InvocationID=d533b7e3-940a-400a-b948-033a0ee6b84b 2021-07-13T00:40:18.357Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f741de33-daa0-4b47-a94f-1a039b1d1bf7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:18.459Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=faaa80ed-00d4-4a8d-bc2e-f4ad4805e5fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1017 EndTimestamp=2021-07-13T00:40:18.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:17.442Z InvocationID=4d95e529-1965-409f-a5fa-82c0e0c1db5d ResponseDesc=OK 2021-07-13T00:40:18.757Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f741de33-daa0-4b47-a94f-1a039b1d1bf7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=540 EndTimestamp=2021-07-13T00:40:18.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:18.217Z InvocationID=5562449a-a95a-4790-b05a-80773c36f08d ResponseDesc=OK 2021-07-13T00:40:18.874Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f4ddaf33-7184-4fdd-81c2-c74b23abc2dc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:18.873Z InvocationID=4d261a4d-6978-4d39-8587-56205c6c0eeb 2021-07-13T00:40:18.959Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f4ddaf33-7184-4fdd-81c2-c74b23abc2dc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:19.568Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f4ddaf33-7184-4fdd-81c2-c74b23abc2dc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=694 EndTimestamp=2021-07-13T00:40:19.567Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:18.873Z InvocationID=a34fb6b9-028f-40ae-ad5f-aebc03eb5dfe ResponseDesc=OK 2021-07-13T00:40:20.774Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ac42263a-0032-4b5f-9499-934bb47c8922 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:20.773Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:20.773Z InvocationID=8fc78360-69c7-4050-859a-146a653885d9 2021-07-13T00:40:21.118Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ac42263a-0032-4b5f-9499-934bb47c8922 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:21.559Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ac42263a-0032-4b5f-9499-934bb47c8922 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=786 EndTimestamp=2021-07-13T00:40:21.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:20.773Z InvocationID=2dde0de4-4dbd-4e6d-b89c-4d054f6ea085 ResponseDesc=OK 2021-07-13T00:40:23.664Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2b385758-8a37-4660-b262-086abc1be878 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:23.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:23.663Z InvocationID=e630d2a2-7b4e-4104-a9bc-d0f56de2fd34 2021-07-13T00:40:23.856Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2b385758-8a37-4660-b262-086abc1be878 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:24.858Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2b385758-8a37-4660-b262-086abc1be878 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1194 EndTimestamp=2021-07-13T00:40:24.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:23.663Z InvocationID=f12ac34c-cb2e-4535-9f41-e8fb843493bf ResponseDesc=OK 2021-07-13T00:40:26.930Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da52b527-0552-4e12-b494-c1f2b38e80c0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:26.930Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:26.930Z InvocationID=25c8a1ae-d6e8-4e72-839c-535edfe01eff 2021-07-13T00:40:27.059Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da52b527-0552-4e12-b494-c1f2b38e80c0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:27.316Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da52b527-0552-4e12-b494-c1f2b38e80c0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=386 EndTimestamp=2021-07-13T00:40:27.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:26.930Z InvocationID=e5e31512-4a4c-48df-9ac7-b37830879980 ResponseDesc=OK 2021-07-13T00:40:27.439Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c255f399-ff1e-45ad-88de-cfcff89a3bba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:27.439Z InvocationID=e2637ec6-7500-42e0-a811-e600b6400d66 2021-07-13T00:40:27.866Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c255f399-ff1e-45ad-88de-cfcff89a3bba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:28.059Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c255f399-ff1e-45ad-88de-cfcff89a3bba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=620 EndTimestamp=2021-07-13T00:40:28.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:27.439Z InvocationID=8eb7e8d0-07c7-4908-81d2-e3e94be602cb ResponseDesc=OK 2021-07-13T00:40:28.873Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1b8c4d25-61dc-4b59-898c-3ea7e82b5479 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:28.873Z InvocationID=5da4bb1d-7be5-490d-84da-7a8293a6027a 2021-07-13T00:40:29.057Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1b8c4d25-61dc-4b59-898c-3ea7e82b5479 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:29.557Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1b8c4d25-61dc-4b59-898c-3ea7e82b5479 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=684 EndTimestamp=2021-07-13T00:40:29.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:28.873Z InvocationID=17bcc241-2f72-4a8e-92b1-f2b707bdcca0 ResponseDesc=OK 2021-07-13T00:40:30.073Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81dc1ebb-4c37-4254-bcd9-bd0d14c8fcd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:30.073Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:30.073Z InvocationID=f6ddd351-5e8c-4324-ade6-6cdc91226702 2021-07-13T00:40:30.264Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81dc1ebb-4c37-4254-bcd9-bd0d14c8fcd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:30.520Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=81dc1ebb-4c37-4254-bcd9-bd0d14c8fcd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=447 EndTimestamp=2021-07-13T00:40:30.520Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:30.073Z InvocationID=b376b4c2-7f0b-4e55-9cdf-ee54841654ff ResponseDesc=OK 2021-07-13T00:40:32.650Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a9f6018a-1563-446e-9cf8-c908638b5172 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:32.650Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:32.650Z InvocationID=054c5527-c797-47d6-a0d8-fe5180df0312 2021-07-13T00:40:33.715Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a9f6018a-1563-446e-9cf8-c908638b5172 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:34.060Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a9f6018a-1563-446e-9cf8-c908638b5172 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1410 EndTimestamp=2021-07-13T00:40:34.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:32.650Z InvocationID=62e76074-33d8-4a68-b92b-11bf5deb2be2 ResponseDesc=OK 2021-07-13T00:40:36.063Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be85d185-52e4-4ae6-849f-986b7f4f6f39 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:36.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:36.063Z InvocationID=c91f74d9-3f8b-4811-9681-a200e95f41be 2021-07-13T00:40:36.257Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be85d185-52e4-4ae6-849f-986b7f4f6f39 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:37.159Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be85d185-52e4-4ae6-849f-986b7f4f6f39 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1096 EndTimestamp=2021-07-13T00:40:37.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:36.063Z InvocationID=63dbfe87-ab7b-442a-9460-503ed9aaae7f ResponseDesc=OK 2021-07-13T00:40:37.440Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cf2c8882-8d9b-4025-a300-f800d3ab3e35 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:37.440Z InvocationID=cac0b142-9ace-495c-be39-082a01855698 2021-07-13T00:40:37.559Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cf2c8882-8d9b-4025-a300-f800d3ab3e35 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:37.925Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cf2c8882-8d9b-4025-a300-f800d3ab3e35 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=485 EndTimestamp=2021-07-13T00:40:37.925Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:37.440Z InvocationID=bd1aa754-5f68-427f-bea0-04a7675d80c4 ResponseDesc=OK 2021-07-13T00:40:38.581Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3c2b5f77-9a1a-4668-8934-6a4e22abdea2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:38.581Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:38.581Z InvocationID=bf73bac4-677d-4965-9a0e-d39dc7fec563 2021-07-13T00:40:38.822Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3c2b5f77-9a1a-4668-8934-6a4e22abdea2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:38.874Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9732b6e0-e70c-45b1-810c-dce57dd17989 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:38.874Z InvocationID=fbcc520c-7f14-48aa-969a-3d05eb144486 2021-07-13T00:40:39.056Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9732b6e0-e70c-45b1-810c-dce57dd17989 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:39.059Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3c2b5f77-9a1a-4668-8934-6a4e22abdea2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=478 EndTimestamp=2021-07-13T00:40:39.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:38.581Z InvocationID=732c5018-e4b1-4803-84f4-59660ff2dfdd ResponseDesc=OK 2021-07-13T00:40:40.357Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9732b6e0-e70c-45b1-810c-dce57dd17989 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1483 EndTimestamp=2021-07-13T00:40:40.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:38.874Z InvocationID=6dafed87-54f0-4eab-88e0-9d2844b26e34 ResponseDesc=OK 2021-07-13T00:40:42.021Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8ba198f4-15c3-4491-99b8-c5e4e7f45fcb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:42.021Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:42.021Z InvocationID=23868424-2f84-45a6-8f1a-cb8cb67dca3e 2021-07-13T00:40:42.158Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8ba198f4-15c3-4491-99b8-c5e4e7f45fcb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:42.434Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8ba198f4-15c3-4491-99b8-c5e4e7f45fcb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=413 EndTimestamp=2021-07-13T00:40:42.434Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:42.021Z InvocationID=649be9ff-1d80-4146-a2f2-78bd512fdd84 ResponseDesc=OK 2021-07-13T00:40:45.164Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6f1032cb-a3bc-4cda-8aa4-d834dfd814d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:45.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:45.164Z InvocationID=d7deb0f5-2e70-4f09-8f3d-018463926c1e 2021-07-13T00:40:45.431Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6f1032cb-a3bc-4cda-8aa4-d834dfd814d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:45.762Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6f1032cb-a3bc-4cda-8aa4-d834dfd814d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=598 EndTimestamp=2021-07-13T00:40:45.762Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:45.164Z InvocationID=646a9b71-46e0-4b5d-b21f-248c2ecb3b9a ResponseDesc=OK 2021-07-13T00:40:47.440Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8f136f68-932a-40a7-afde-e319ee83c8e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:47.440Z InvocationID=6e50ed47-e9bb-4130-907c-7dd5677fbc95 2021-07-13T00:40:48.874Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=20926c12-7f15-4ac8-ac77-41da1ca07b73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:48.874Z InvocationID=7c9e3877-282b-42e4-8ad4-89c59b4a4ecb 2021-07-13T00:40:50.527Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=95923b86-7fcc-4ac8-b588-bad8a06b80cd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:40:50.526Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:50.526Z InvocationID=cd3f17dc-47a5-43f0-98e2-d600e703672a 2021-07-13T00:40:50.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8f136f68-932a-40a7-afde-e319ee83c8e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:40:53.276Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=95923b86-7fcc-4ac8-b588-bad8a06b80cd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:00.889Z [qtp817348612-67] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=20926c12-7f15-4ac8-ac77-41da1ca07b73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:41:02.169Z [qtp817348612-51] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=8f136f68-932a-40a7-afde-e319ee83c8e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureCassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:41:02.170Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=8f136f68-932a-40a7-afde-e319ee83c8e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:41:02.170Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=8f136f68-932a-40a7-afde-e319ee83c8e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=14730 EndTimestamp=2021-07-13T00:41:02.170Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:47.440Z InvocationID=2d91c369-0f49-44fd-84e3-9bb54163e2e5 ResponseDesc=Internal Server Error 2021-07-13T00:41:02.175Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fda316c4-3f7d-4f72-bd93-fcffd53a9a8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:02.174Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:02.174Z InvocationID=1092e075-9c72-4b17-b4d8-16003670fa0d 2021-07-13T00:41:03.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=03dd7963-7162-4994-a0cd-0868fee965ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:03.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:03.873Z InvocationID=2e275d4b-d31c-4b7a-9074-6f1045f9085f 2021-07-13T00:41:05.285Z [qtp817348612-69] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=95923b86-7fcc-4ac8-b588-bad8a06b80cd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:41:06.357Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fda316c4-3f7d-4f72-bd93-fcffd53a9a8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:07.654Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e101c8ab-33a9-4604-9d74-ca4aafff01f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:07.654Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:07.654Z InvocationID=0ec00930-c716-4a90-a072-6733be0a0c02 2021-07-13T00:41:07.757Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e101c8ab-33a9-4604-9d74-ca4aafff01f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:09.360Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=20926c12-7f15-4ac8-ac77-41da1ca07b73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=20486 EndTimestamp=2021-07-13T00:41:09.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:48.874Z InvocationID=1811cc63-6bce-406f-b1a1-d1e66b4cc351 ResponseDesc=Internal Server Error 2021-07-13T00:41:10.016Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=95923b86-7fcc-4ac8-b588-bad8a06b80cd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=19490 EndTimestamp=2021-07-13T00:41:10.016Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:40:50.526Z InvocationID=666a33f2-31dc-4d64-95a0-86e4583c2c96 ResponseDesc=Internal Server Error 2021-07-13T00:41:10.018Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=03dd7963-7162-4994-a0cd-0868fee965ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:10.068Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e101c8ab-33a9-4604-9d74-ca4aafff01f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2414 EndTimestamp=2021-07-13T00:41:10.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:07.654Z InvocationID=9a0bfd4c-aaf6-4313-baf8-172c1d9b5744 ResponseDesc=OK 2021-07-13T00:41:13.391Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=03dd7963-7162-4994-a0cd-0868fee965ca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=9517 EndTimestamp=2021-07-13T00:41:13.390Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:03.873Z InvocationID=f121cc3a-acdc-44d3-b524-aa932512a011 ResponseDesc=OK 2021-07-13T00:41:13.395Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be7c84ef-3be3-4fc0-8f9f-6dc5c61f47e6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:13.395Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:13.395Z InvocationID=aebab05d-daea-4f07-92d7-fd078c9de4f8 2021-07-13T00:41:13.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be7c84ef-3be3-4fc0-8f9f-6dc5c61f47e6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:13.812Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be7c84ef-3be3-4fc0-8f9f-6dc5c61f47e6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=417 EndTimestamp=2021-07-13T00:41:13.812Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:13.395Z InvocationID=6bd4cd90-a40a-4d96-b940-495fec544685 ResponseDesc=OK 2021-07-13T00:41:15.178Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=891d7fa6-26da-466a-b9f4-a4419701ba68 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:15.178Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:15.178Z InvocationID=d43d06c3-a3ad-4e4b-ad45-f91edae8d290 2021-07-13T00:41:15.260Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=891d7fa6-26da-466a-b9f4-a4419701ba68 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:15.457Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=891d7fa6-26da-466a-b9f4-a4419701ba68 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=279 EndTimestamp=2021-07-13T00:41:15.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:15.178Z InvocationID=59cdcc23-7c42-4b14-9cd3-5d4eecd77d26 ResponseDesc=OK 2021-07-13T00:41:16.362Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=fda316c4-3f7d-4f72-bd93-fcffd53a9a8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:41:17.139Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=fda316c4-3f7d-4f72-bd93-fcffd53a9a8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=14965 EndTimestamp=2021-07-13T00:41:17.139Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:02.174Z InvocationID=38418844-126d-4142-8a66-3de34efb5a29 ResponseDesc=Internal Server Error 2021-07-13T00:41:17.142Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cd2e68ba-6340-4376-8688-91e0895e022f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:17.142Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:17.142Z InvocationID=b371e41e-f8cf-4a42-a5a4-e7dc6dbb5f24 2021-07-13T00:41:17.311Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cd2e68ba-6340-4376-8688-91e0895e022f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:17.560Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cd2e68ba-6340-4376-8688-91e0895e022f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=417 EndTimestamp=2021-07-13T00:41:17.559Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:17.142Z InvocationID=bd2dccce-eb04-4f3b-a44d-383b93b36cbc ResponseDesc=OK 2021-07-13T00:41:17.564Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d9d536df-011b-4bcd-90fd-ee7ad139a2b6 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:41:17.563Z ElapsedTime=0 EndTimestamp=2021-07-13T00:41:17.563Z InvocationID=b0cb55ea-b8f7-495f-a067-7f63f32d9db6 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:41:17.756Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d9d536df-011b-4bcd-90fd-ee7ad139a2b6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:18.057Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d9d536df-011b-4bcd-90fd-ee7ad139a2b6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=494 EndTimestamp=2021-07-13T00:41:18.057Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:17.563Z InvocationID=6f34b743-8e17-4c91-9f98-5f7e4c91bbe7 ResponseDesc=OK 2021-07-13T00:41:18.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f2afcc3b-aa14-4017-b6a9-d76114fdd9e6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:18.873Z InvocationID=82173cd2-3191-4da5-b0f3-3e3ed235d578 2021-07-13T00:41:19.171Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f2afcc3b-aa14-4017-b6a9-d76114fdd9e6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:19.640Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=79becc10-3d83-4f2e-ad40-948b3b45c627 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:19.640Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:19.640Z InvocationID=759ba5dc-5ac8-459a-872f-1cefbe03c307 2021-07-13T00:41:20.441Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f2afcc3b-aa14-4017-b6a9-d76114fdd9e6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1567 EndTimestamp=2021-07-13T00:41:20.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:18.873Z InvocationID=30e78b6b-0a23-4f19-9890-9725f824550a ResponseDesc=OK 2021-07-13T00:41:25.113Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=79becc10-3d83-4f2e-ad40-948b3b45c627 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:25.359Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=79becc10-3d83-4f2e-ad40-948b3b45c627 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5719 EndTimestamp=2021-07-13T00:41:25.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:19.640Z InvocationID=73034002-baed-4385-9afb-497a93c5e474 ResponseDesc=OK 2021-07-13T00:41:26.342Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a4408b69-2ac6-4e0d-990e-fcc3888e9f06 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:26.342Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:26.342Z InvocationID=94f20e12-8bc2-4fec-a93d-4502e0bbeee7 2021-07-13T00:41:26.457Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a4408b69-2ac6-4e0d-990e-fcc3888e9f06 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:26.766Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a4408b69-2ac6-4e0d-990e-fcc3888e9f06 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=424 EndTimestamp=2021-07-13T00:41:26.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:26.342Z InvocationID=f5a0caa8-c597-4e1c-a3ea-69f4a7a59850 ResponseDesc=OK 2021-07-13T00:41:27.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=603bb9ff-d379-40b9-a5a9-eaba2e358ca4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:27.439Z InvocationID=7633cb31-0d28-4d60-b93b-a240dd2be650 2021-07-13T00:41:27.559Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=603bb9ff-d379-40b9-a5a9-eaba2e358ca4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:27.823Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=603bb9ff-d379-40b9-a5a9-eaba2e358ca4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=383 EndTimestamp=2021-07-13T00:41:27.822Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:27.439Z InvocationID=2bb6d7c5-e586-4db0-88fb-02d002c5aa70 ResponseDesc=OK 2021-07-13T00:41:28.874Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3b1832f1-0f0d-463d-aea0-9a7b1f9e5e92 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:28.873Z InvocationID=ebf0aa53-27e4-4650-8dc5-5c955e2e98e7 2021-07-13T00:41:29.030Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c6a27d25-1099-489b-9df8-69376a296fca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:29.030Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:29.030Z InvocationID=480e3090-17e2-466c-becf-ba0839a5d04f 2021-07-13T00:41:29.261Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c6a27d25-1099-489b-9df8-69376a296fca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:30.761Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c6a27d25-1099-489b-9df8-69376a296fca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1731 EndTimestamp=2021-07-13T00:41:30.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:29.030Z InvocationID=4577f1e2-0b2d-4de6-8012-607bedd37851 ResponseDesc=OK 2021-07-13T00:41:32.730Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=69739a38-a36e-4430-8744-bb1168a45718 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:32.730Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:32.730Z InvocationID=b05ebd1f-3f2c-4900-8476-cb63dd7c5fb8 2021-07-13T00:41:33.814Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3b1832f1-0f0d-463d-aea0-9a7b1f9e5e92 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:33.916Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=69739a38-a36e-4430-8744-bb1168a45718 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:34.058Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3b1832f1-0f0d-463d-aea0-9a7b1f9e5e92 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5184 EndTimestamp=2021-07-13T00:41:34.057Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:28.873Z InvocationID=25f43b0f-062a-4a8d-bfee-c0f906f0e79d ResponseDesc=OK 2021-07-13T00:41:34.316Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=69739a38-a36e-4430-8744-bb1168a45718 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1586 EndTimestamp=2021-07-13T00:41:34.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:32.730Z InvocationID=3199deba-c517-4815-ae0f-afa71f3d226d ResponseDesc=OK 2021-07-13T00:41:37.439Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4f1537ce-42c2-4791-bb5b-ecf5494c2d0b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:37.439Z InvocationID=cc57724a-1d3a-4b5f-9f7e-db6b43652af8 2021-07-13T00:41:37.714Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4f1537ce-42c2-4791-bb5b-ecf5494c2d0b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:38.874Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7d1add21-cf54-4e5e-a177-efe023ac2fac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:38.874Z InvocationID=344fc0f7-975a-4b5e-b7ae-cb1c56089971 2021-07-13T00:41:47.361Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7d1add21-cf54-4e5e-a177-efe023ac2fac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:47.451Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0d1ec888-239b-4d3b-8df8-405d584bdfb0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:47.450Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:47.450Z InvocationID=756de477-f989-421a-a955-7063c3c9b077 2021-07-13T00:41:47.559Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0d1ec888-239b-4d3b-8df8-405d584bdfb0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:47.658Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7d1add21-cf54-4e5e-a177-efe023ac2fac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=8784 EndTimestamp=2021-07-13T00:41:47.658Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:38.874Z InvocationID=9b36d5cb-ed71-488a-bc2a-768257b0836f ResponseDesc=OK 2021-07-13T00:41:47.835Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0d1ec888-239b-4d3b-8df8-405d584bdfb0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=385 EndTimestamp=2021-07-13T00:41:47.835Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:47.450Z InvocationID=dcb2bacb-73a6-4ec7-92b5-09b03a6e16f5 ResponseDesc=OK 2021-07-13T00:41:47.859Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4f1537ce-42c2-4791-bb5b-ecf5494c2d0b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=10420 EndTimestamp=2021-07-13T00:41:47.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:37.439Z InvocationID=b8e6ed7d-b629-42f7-8e3d-f967ab65fa44 ResponseDesc=OK 2021-07-13T00:41:47.864Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9c753d19-6af8-4087-bfe5-83f5c621aabd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:47.864Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:47.864Z InvocationID=0784dc59-7ca7-4adb-8d72-59750cdbe6da 2021-07-13T00:41:48.410Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9c753d19-6af8-4087-bfe5-83f5c621aabd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:48.572Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9c753d19-6af8-4087-bfe5-83f5c621aabd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=708 EndTimestamp=2021-07-13T00:41:48.572Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:47.864Z InvocationID=a875b3db-5c95-4142-a504-185f73e9c8c9 ResponseDesc=OK 2021-07-13T00:41:48.874Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=55151088-c754-48ee-b62c-fc49827aa831 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:48.874Z InvocationID=59a96bae-9764-4600-ae48-27821efa9ab6 2021-07-13T00:41:49.066Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=99cb89e0-a692-43a2-b915-b8a76f81ed7f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:49.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:49.065Z InvocationID=fe1d58ed-25f9-4057-8205-21d73f56bde0 2021-07-13T00:41:51.358Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=55151088-c754-48ee-b62c-fc49827aa831 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:51.410Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=99cb89e0-a692-43a2-b915-b8a76f81ed7f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:51.558Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=55151088-c754-48ee-b62c-fc49827aa831 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2683 EndTimestamp=2021-07-13T00:41:51.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:48.874Z InvocationID=f21ed666-8b96-44b7-a132-2b31b7d3ec67 ResponseDesc=OK 2021-07-13T00:41:51.816Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=99cb89e0-a692-43a2-b915-b8a76f81ed7f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2751 EndTimestamp=2021-07-13T00:41:51.816Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:49.065Z InvocationID=b80d8278-54ae-4f1a-96e0-62b8ed10b353 ResponseDesc=OK 2021-07-13T00:41:52.575Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ef5bac63-821a-4df3-9873-8ca5de5e74d6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:52.575Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:52.575Z InvocationID=3e527873-8132-4164-9d01-2e8bb4148fa3 2021-07-13T00:41:53.651Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ef5bac63-821a-4df3-9873-8ca5de5e74d6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:53.669Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ef5bac63-821a-4df3-9873-8ca5de5e74d6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1094 EndTimestamp=2021-07-13T00:41:53.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:52.575Z InvocationID=7b9812c1-0537-4420-bc44-43be1168f609 ResponseDesc=OK 2021-07-13T00:41:55.094Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9a4856fa-5244-4fc0-9be8-1dbff614b6dd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:55.093Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:55.093Z InvocationID=796ab3a0-dba1-4a7e-b42f-6d594fab753e 2021-07-13T00:41:55.256Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9a4856fa-5244-4fc0-9be8-1dbff614b6dd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:55.457Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9a4856fa-5244-4fc0-9be8-1dbff614b6dd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=364 EndTimestamp=2021-07-13T00:41:55.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:55.093Z InvocationID=48828487-ebbd-4a02-aa5b-a32ca15b203c ResponseDesc=OK 2021-07-13T00:41:56.466Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d4e3f28-18f9-4ee7-b448-077c6d3b452e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:56.466Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:56.466Z InvocationID=93585afc-f3c5-447a-9d6e-4d9ed583ef82 2021-07-13T00:41:56.559Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d4e3f28-18f9-4ee7-b448-077c6d3b452e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:56.767Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d4e3f28-18f9-4ee7-b448-077c6d3b452e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=301 EndTimestamp=2021-07-13T00:41:56.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:56.466Z InvocationID=751eeb57-e305-408d-bb95-f28a20ab7bdf ResponseDesc=OK 2021-07-13T00:41:57.441Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6192d9c5-758b-4a68-a329-8185cc081b4a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:57.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:57.441Z InvocationID=d699b4f8-1298-4353-83ad-69e73bec25fa 2021-07-13T00:41:57.617Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6192d9c5-758b-4a68-a329-8185cc081b4a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:57.880Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6192d9c5-758b-4a68-a329-8185cc081b4a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:41:57.880Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:57.441Z InvocationID=788e6b64-4be1-4514-9562-0b1cd3e987f8 ResponseDesc=OK 2021-07-13T00:41:58.165Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=45200437-de8d-40af-b758-ca22a69315bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:58.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:58.165Z InvocationID=ff9c0047-16a0-47e5-96da-1edbc40a82df 2021-07-13T00:41:58.261Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=45200437-de8d-40af-b758-ca22a69315bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:58.757Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=45200437-de8d-40af-b758-ca22a69315bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=592 EndTimestamp=2021-07-13T00:41:58.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:58.165Z InvocationID=405fdbae-455f-4f5f-884f-0e65bbc16ce0 ResponseDesc=OK 2021-07-13T00:41:58.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1c4d996b-7234-4589-b1ce-1da27df5ef58 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:41:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:58.874Z InvocationID=2c2e35de-1e3c-4272-b44c-6d0be1f3dcb0 2021-07-13T00:41:58.960Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1c4d996b-7234-4589-b1ce-1da27df5ef58 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:41:59.318Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1c4d996b-7234-4589-b1ce-1da27df5ef58 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=444 EndTimestamp=2021-07-13T00:41:59.318Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:41:58.874Z InvocationID=f1be18be-6b91-47cb-80bc-5724f69b64f7 ResponseDesc=OK 2021-07-13T00:42:00.067Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2816976f-97dc-4188-9cc1-a30ff25d4d89 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:00.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:00.067Z InvocationID=f555ba6c-d180-4f65-90be-45b42323e3d2 2021-07-13T00:42:00.618Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2816976f-97dc-4188-9cc1-a30ff25d4d89 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:00.959Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2816976f-97dc-4188-9cc1-a30ff25d4d89 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=892 EndTimestamp=2021-07-13T00:42:00.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:00.067Z InvocationID=c7350757-2c69-4694-963f-a150055c1730 ResponseDesc=OK 2021-07-13T00:42:02.086Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1b1aa9e7-9b63-45d0-adc3-e36227406173 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:02.086Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:02.086Z InvocationID=54e42243-98e7-4d9f-9f7c-41c743a08cac 2021-07-13T00:42:02.168Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1b1aa9e7-9b63-45d0-adc3-e36227406173 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:06.657Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1b1aa9e7-9b63-45d0-adc3-e36227406173 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4571 EndTimestamp=2021-07-13T00:42:06.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:02.086Z InvocationID=79a21fa5-ef7c-40a6-9ea6-8bd588041ba1 ResponseDesc=OK 2021-07-13T00:42:07.440Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e80602a8-193e-47ee-807e-4b700cfc8ff1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:07.439Z InvocationID=f06f5524-9877-4505-b0f5-55965f4c5740 2021-07-13T00:42:07.562Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e80602a8-193e-47ee-807e-4b700cfc8ff1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:07.920Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e80602a8-193e-47ee-807e-4b700cfc8ff1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=481 EndTimestamp=2021-07-13T00:42:07.920Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:07.439Z InvocationID=525fe54c-3e16-4a00-9f38-50261c4f6ba8 ResponseDesc=OK 2021-07-13T00:42:08.873Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d34f64a8-c753-4089-9a5d-0378c88ec9ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:08.873Z InvocationID=b0ed77c6-57d0-4020-8048-d02dad1f1651 2021-07-13T00:42:09.118Z [qtp817348612-11] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d34f64a8-c753-4089-9a5d-0378c88ec9ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:09.372Z [qtp817348612-11] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d34f64a8-c753-4089-9a5d-0378c88ec9ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=499 EndTimestamp=2021-07-13T00:42:09.372Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:08.873Z InvocationID=7bb6b980-f918-458b-aeb9-b4f851d587d3 ResponseDesc=OK 2021-07-13T00:42:09.877Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=94260c62-cf2c-4fb5-99ac-4bc59b64577c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:09.877Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:09.877Z InvocationID=a85427f9-4e6c-4885-bf9c-d98751d966c8 2021-07-13T00:42:10.060Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=94260c62-cf2c-4fb5-99ac-4bc59b64577c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:17.442Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8fb43561-414f-4678-a281-6083e35c888d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:17.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:17.441Z InvocationID=f1a4747d-40ff-4c3e-aad4-2e504363f428 2021-07-13T00:42:17.559Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8fb43561-414f-4678-a281-6083e35c888d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:18.014Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8fb43561-414f-4678-a281-6083e35c888d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=573 EndTimestamp=2021-07-13T00:42:18.014Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:17.441Z InvocationID=7575f42f-83be-4045-b134-d5e4481ffb6f ResponseDesc=OK 2021-07-13T00:42:18.057Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=94260c62-cf2c-4fb5-99ac-4bc59b64577c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=8180 EndTimestamp=2021-07-13T00:42:18.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:09.877Z InvocationID=507e698f-56b7-4d45-95ef-882027e175a7 ResponseDesc=OK 2021-07-13T00:42:18.874Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0419070d-b4e4-4eb8-8f02-119f648d7910 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:18.874Z InvocationID=e67ee162-7040-4590-91d8-a7a1637ac8ee 2021-07-13T00:42:24.319Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0419070d-b4e4-4eb8-8f02-119f648d7910 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:24.417Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0419070d-b4e4-4eb8-8f02-119f648d7910 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5543 EndTimestamp=2021-07-13T00:42:24.417Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:18.874Z InvocationID=4dc3fdec-8a14-4071-b8e8-523ae770fa48 ResponseDesc=OK 2021-07-13T00:42:25.783Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d94367b-6132-4ee0-b9ae-81daae8d82e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:25.782Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:25.782Z InvocationID=bc94336f-13dc-4d62-844e-935d8056add1 2021-07-13T00:42:25.957Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d94367b-6132-4ee0-b9ae-81daae8d82e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:27.440Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4e06a188-b175-43ac-a9af-4dcf1aeddf76 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:27.440Z InvocationID=442830cc-73eb-42bd-b839-d3bc59febf9f 2021-07-13T00:42:27.558Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d94367b-6132-4ee0-b9ae-81daae8d82e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1776 EndTimestamp=2021-07-13T00:42:27.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:25.782Z InvocationID=d04a82d6-1eac-4741-abe2-a74046ea7bd7 ResponseDesc=OK 2021-07-13T00:42:27.659Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4e06a188-b175-43ac-a9af-4dcf1aeddf76 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:28.212Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4e06a188-b175-43ac-a9af-4dcf1aeddf76 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=772 EndTimestamp=2021-07-13T00:42:28.212Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:27.440Z InvocationID=51245485-ab8d-45c3-9981-87c732f3db85 ResponseDesc=OK 2021-07-13T00:42:28.565Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a501a5ba-6498-4b02-a4e3-28eb1141c38d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:28.564Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:28.564Z InvocationID=7b4c53ff-7d26-4a1e-8584-8615052d8cda 2021-07-13T00:42:28.813Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a501a5ba-6498-4b02-a4e3-28eb1141c38d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:28.874Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=785d26a1-5ba6-4ce7-b3dc-b8563fdbd974 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:28.874Z InvocationID=bb837f9b-0dea-4ce6-abc9-808381154825 2021-07-13T00:42:29.157Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=785d26a1-5ba6-4ce7-b3dc-b8563fdbd974 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:29.159Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a501a5ba-6498-4b02-a4e3-28eb1141c38d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=595 EndTimestamp=2021-07-13T00:42:29.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:28.564Z InvocationID=9543be26-e964-4cab-8c3e-77e418d260ab ResponseDesc=OK 2021-07-13T00:42:29.558Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=785d26a1-5ba6-4ce7-b3dc-b8563fdbd974 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=684 EndTimestamp=2021-07-13T00:42:29.558Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:28.874Z InvocationID=b2201b19-237a-488c-b0ca-0417ec45df5a ResponseDesc=OK 2021-07-13T00:42:31.022Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=898c4e9c-ae18-4838-922b-631d70725c57 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:31.022Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:31.022Z InvocationID=749f95c1-41ad-407d-9c0a-e4d74cf3cd84 2021-07-13T00:42:31.162Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=898c4e9c-ae18-4838-922b-631d70725c57 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:31.660Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=898c4e9c-ae18-4838-922b-631d70725c57 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=638 EndTimestamp=2021-07-13T00:42:31.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:31.022Z InvocationID=927b5cb5-e958-48d9-97b2-b6b978c6d4ac ResponseDesc=OK 2021-07-13T00:42:32.872Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=11e27d75-2228-4c4e-b17e-2eaa0a84db47 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:32.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:32.871Z InvocationID=9e5c1ce0-521f-4a63-906f-89554776a240 2021-07-13T00:42:33.016Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=11e27d75-2228-4c4e-b17e-2eaa0a84db47 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:33.260Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=11e27d75-2228-4c4e-b17e-2eaa0a84db47 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=389 EndTimestamp=2021-07-13T00:42:33.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:32.871Z InvocationID=a31032bd-cad8-4d43-9740-44d70eebbdd9 ResponseDesc=OK 2021-07-13T00:42:35.133Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=979d88a7-c741-4123-9f9d-4296e1670d20 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:35.133Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:35.133Z InvocationID=be91393b-3516-40d2-afe0-8d4e04c451d0 2021-07-13T00:42:35.261Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=979d88a7-c741-4123-9f9d-4296e1670d20 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:35.564Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=979d88a7-c741-4123-9f9d-4296e1670d20 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=431 EndTimestamp=2021-07-13T00:42:35.564Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:35.133Z InvocationID=37563f43-1eb4-494a-a30f-d274ae910aa9 ResponseDesc=OK 2021-07-13T00:42:36.470Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1f848031-f34c-425d-ac3f-450a99613f49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:36.469Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:36.469Z InvocationID=177fe1cf-b12d-47e8-b3f7-d895d3cc18b2 2021-07-13T00:42:36.659Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1f848031-f34c-425d-ac3f-450a99613f49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:37.123Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1f848031-f34c-425d-ac3f-450a99613f49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=654 EndTimestamp=2021-07-13T00:42:37.123Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:36.469Z InvocationID=a1032635-ebe5-473a-8262-95e040884eeb ResponseDesc=OK 2021-07-13T00:42:37.440Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=71a532ad-eebe-4d0e-9bd0-c8cd6c3214b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:37.439Z InvocationID=70a2006e-ed30-4010-a468-8abc6c4dd581 2021-07-13T00:42:37.737Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=71a532ad-eebe-4d0e-9bd0-c8cd6c3214b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:37.961Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=71a532ad-eebe-4d0e-9bd0-c8cd6c3214b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=522 EndTimestamp=2021-07-13T00:42:37.961Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:37.439Z InvocationID=9c4a4709-bdff-4275-af4a-2ef5ed92ac61 ResponseDesc=OK 2021-07-13T00:42:38.369Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ff7e6a33-fd86-4b0b-bf0e-dc36746810d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:38.369Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:38.369Z InvocationID=0df834b7-c6f4-4a36-8008-a48e75a9cd94 2021-07-13T00:42:38.464Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ff7e6a33-fd86-4b0b-bf0e-dc36746810d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:38.857Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ff7e6a33-fd86-4b0b-bf0e-dc36746810d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=488 EndTimestamp=2021-07-13T00:42:38.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:38.369Z InvocationID=4c75df69-d133-4449-9fc0-ba40f8a87488 ResponseDesc=OK 2021-07-13T00:42:38.873Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=98e3c6a6-023b-4705-a076-9d916acc1609 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:38.873Z InvocationID=a436e16d-80c1-41b3-bfe0-09a60e0c0b41 2021-07-13T00:42:39.459Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=98e3c6a6-023b-4705-a076-9d916acc1609 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:39.815Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=98e3c6a6-023b-4705-a076-9d916acc1609 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=942 EndTimestamp=2021-07-13T00:42:39.815Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:38.873Z InvocationID=c63d63c0-9d5c-45b1-8527-e83136de7d49 ResponseDesc=OK 2021-07-13T00:42:40.264Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4ed01de6-043c-41b2-8557-546f66b3e5b2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:40.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:40.264Z InvocationID=f4823388-0205-42b6-a1a7-12f36e1fc560 2021-07-13T00:42:40.412Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4ed01de6-043c-41b2-8557-546f66b3e5b2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:40.659Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4ed01de6-043c-41b2-8557-546f66b3e5b2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=395 EndTimestamp=2021-07-13T00:42:40.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:40.264Z InvocationID=47c6798e-bcfb-46da-9e05-01a2b1d683c3 ResponseDesc=OK 2021-07-13T00:42:41.760Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fd97747c-c779-4326-b772-fc6953b38c72 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:41.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:41.759Z InvocationID=a32b34dd-d1b3-41dc-91d4-bc9b8477cf17 2021-07-13T00:42:41.856Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fd97747c-c779-4326-b772-fc6953b38c72 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:42.257Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fd97747c-c779-4326-b772-fc6953b38c72 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=498 EndTimestamp=2021-07-13T00:42:42.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:41.759Z InvocationID=99477c68-42e6-4410-96ea-653326867c47 ResponseDesc=OK 2021-07-13T00:42:43.422Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=401bf434-a85a-4c27-8ba0-6b0ebe3d5c7d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:43.422Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:43.422Z InvocationID=925062a1-4777-41d3-8430-98ef422ab313 2021-07-13T00:42:43.560Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=401bf434-a85a-4c27-8ba0-6b0ebe3d5c7d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:43.815Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=401bf434-a85a-4c27-8ba0-6b0ebe3d5c7d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=393 EndTimestamp=2021-07-13T00:42:43.815Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:43.422Z InvocationID=7bd1a96f-6f9f-43e3-80b6-fd379227732f ResponseDesc=OK 2021-07-13T00:42:44.966Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aa157e3d-6e9d-42fa-966c-1677dd8d041e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:44.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:44.966Z InvocationID=9087d2fd-8255-4622-a23b-3b51e66cd4b1 2021-07-13T00:42:45.614Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aa157e3d-6e9d-42fa-966c-1677dd8d041e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:47.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f47fe38d-910e-4274-bd21-c17ac1aab3a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:47.439Z InvocationID=3fca980c-60fc-4705-b762-903a9ca24c57 2021-07-13T00:42:47.730Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aa157e3d-6e9d-42fa-966c-1677dd8d041e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2764 EndTimestamp=2021-07-13T00:42:47.730Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:44.966Z InvocationID=b7844c99-bf2f-4436-9199-c74b62848c9a ResponseDesc=OK 2021-07-13T00:42:47.759Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f47fe38d-910e-4274-bd21-c17ac1aab3a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:48.157Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f47fe38d-910e-4274-bd21-c17ac1aab3a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=718 EndTimestamp=2021-07-13T00:42:48.157Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:47.439Z InvocationID=9aaf062a-3456-4f4a-8995-cb6171eb3e57 ResponseDesc=OK 2021-07-13T00:42:48.875Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=376110da-4dea-4b4b-b0cb-34559fc706c5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:48.875Z InvocationID=a465dacf-38f6-43e7-a6f0-24bea96dea81 2021-07-13T00:42:48.959Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=376110da-4dea-4b4b-b0cb-34559fc706c5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:49.071Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e3bb7b49-a0f4-4770-b32c-3b9207b7b4e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:49.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:49.071Z InvocationID=d3571a68-92e3-4e81-aa7e-1844c42564b5 2021-07-13T00:42:49.700Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=376110da-4dea-4b4b-b0cb-34559fc706c5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=825 EndTimestamp=2021-07-13T00:42:49.700Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:48.875Z InvocationID=ff934a60-2e1c-4700-8a71-20ef509685f7 ResponseDesc=OK 2021-07-13T00:42:49.710Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e3bb7b49-a0f4-4770-b32c-3b9207b7b4e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:49.859Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e3bb7b49-a0f4-4770-b32c-3b9207b7b4e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=788 EndTimestamp=2021-07-13T00:42:49.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:49.071Z InvocationID=6f3a3ffa-0c65-4831-9048-728eba07e118 ResponseDesc=OK 2021-07-13T00:42:51.061Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=610f1626-b07b-4317-a1a8-849e1886eb75 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:51.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:51.061Z InvocationID=c1334e03-470d-41eb-9733-670e6bd8d4ec 2021-07-13T00:42:51.157Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=610f1626-b07b-4317-a1a8-849e1886eb75 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:51.557Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=610f1626-b07b-4317-a1a8-849e1886eb75 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:42:51.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:51.061Z InvocationID=bb6d49e0-e37f-4cbe-a047-2477514d1e51 ResponseDesc=OK 2021-07-13T00:42:52.977Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3bbe164f-7292-4c21-9fe9-a4dc44f33ff7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:52.977Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:52.977Z InvocationID=86ea9702-868f-4fba-bce6-22a5276d30b4 2021-07-13T00:42:53.359Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3bbe164f-7292-4c21-9fe9-a4dc44f33ff7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:53.574Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3bbe164f-7292-4c21-9fe9-a4dc44f33ff7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=596 EndTimestamp=2021-07-13T00:42:53.573Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:52.977Z InvocationID=e55b19d9-7345-414c-ba6e-8da17a78b918 ResponseDesc=OK 2021-07-13T00:42:54.865Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=817f6b54-d052-4b95-954f-02d7a8cefbf3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:54.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:54.864Z InvocationID=4fb6457b-6ce3-42a1-aa3e-8dcf299ddd18 2021-07-13T00:42:55.032Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=817f6b54-d052-4b95-954f-02d7a8cefbf3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:55.260Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=817f6b54-d052-4b95-954f-02d7a8cefbf3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=396 EndTimestamp=2021-07-13T00:42:55.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:54.864Z InvocationID=2cf1a12d-f50e-417b-890a-7b771a844bdf ResponseDesc=OK 2021-07-13T00:42:56.178Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=938dd2f3-6f1d-42f2-95d7-89c9d35a7fe4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:56.178Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:56.178Z InvocationID=38f08314-4373-4e5e-a8ca-0effe3a5fd2f 2021-07-13T00:42:56.357Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=938dd2f3-6f1d-42f2-95d7-89c9d35a7fe4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:56.757Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=938dd2f3-6f1d-42f2-95d7-89c9d35a7fe4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=579 EndTimestamp=2021-07-13T00:42:56.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:56.178Z InvocationID=da8893b6-cee7-4cd6-8162-151b6816f95c ResponseDesc=OK 2021-07-13T00:42:57.440Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dced36d0-0aa3-425c-92b0-dca80913e0e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:57.440Z InvocationID=f1f53528-c2b1-4644-99b9-04d224b547e9 2021-07-13T00:42:57.659Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dced36d0-0aa3-425c-92b0-dca80913e0e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:58.031Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dced36d0-0aa3-425c-92b0-dca80913e0e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=591 EndTimestamp=2021-07-13T00:42:58.031Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:57.440Z InvocationID=c38aa838-e475-46be-bebf-b8e67343d148 ResponseDesc=OK 2021-07-13T00:42:58.162Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ad7a064c-217a-42b1-9162-4bd9f7236b14 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:58.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:58.162Z InvocationID=a0313a79-076d-4f03-bf78-329944b40309 2021-07-13T00:42:58.418Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ad7a064c-217a-42b1-9162-4bd9f7236b14 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:58.759Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ad7a064c-217a-42b1-9162-4bd9f7236b14 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=597 EndTimestamp=2021-07-13T00:42:58.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:58.162Z InvocationID=e9dcfa0e-e8b0-4f0f-bee5-42d67325e855 ResponseDesc=OK 2021-07-13T00:42:58.874Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9e7b22fa-9249-4597-bf0d-67379964e2d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:42:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:58.874Z InvocationID=ba86f113-c7a5-479d-8b93-9009ca938572 2021-07-13T00:42:59.057Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9e7b22fa-9249-4597-bf0d-67379964e2d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:42:59.458Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9e7b22fa-9249-4597-bf0d-67379964e2d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=584 EndTimestamp=2021-07-13T00:42:59.458Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:42:58.874Z InvocationID=86d0ea09-686e-4a10-80b0-17cef805c7b9 ResponseDesc=OK 2021-07-13T00:43:00.113Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=02ef24e7-d881-4507-be54-2e43880cfb3a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:00.113Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:00.113Z InvocationID=34765ab4-89a4-47f9-9181-ccaebdf1a6b9 2021-07-13T00:43:00.258Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=02ef24e7-d881-4507-be54-2e43880cfb3a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:00.562Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=02ef24e7-d881-4507-be54-2e43880cfb3a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=449 EndTimestamp=2021-07-13T00:43:00.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:00.113Z InvocationID=5d482208-8f6d-4d28-bed1-f562c5406cb5 ResponseDesc=OK 2021-07-13T00:43:01.367Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=28076472-96f9-4a5d-bf8b-7c72ad49ac22 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:01.367Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:01.367Z InvocationID=24990894-c57b-43c0-add9-b33e0d372d47 2021-07-13T00:43:01.625Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=28076472-96f9-4a5d-bf8b-7c72ad49ac22 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:01.860Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=28076472-96f9-4a5d-bf8b-7c72ad49ac22 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=492 EndTimestamp=2021-07-13T00:43:01.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:01.367Z InvocationID=c6b16bc3-c30d-445e-b3fa-ac0749e3034a ResponseDesc=OK 2021-07-13T00:43:02.665Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dada234a-cbd8-4d6e-b264-984b917cab0b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:02.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:02.665Z InvocationID=b4ea3965-f547-4990-872a-8a5f1fb1e24b 2021-07-13T00:43:02.761Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dada234a-cbd8-4d6e-b264-984b917cab0b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:03.157Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dada234a-cbd8-4d6e-b264-984b917cab0b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=492 EndTimestamp=2021-07-13T00:43:03.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:02.665Z InvocationID=5a851eec-5229-4fd0-91df-b6cf229851a8 ResponseDesc=OK 2021-07-13T00:43:04.364Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b63f84ab-7465-4a4c-ad30-9cf81d5b47f1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:04.364Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:04.364Z InvocationID=ee926a4f-9056-486b-aaeb-728083b0f993 2021-07-13T00:43:04.659Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b63f84ab-7465-4a4c-ad30-9cf81d5b47f1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:04.930Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b63f84ab-7465-4a4c-ad30-9cf81d5b47f1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=566 EndTimestamp=2021-07-13T00:43:04.930Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:04.364Z InvocationID=6a8a841b-30af-4171-9661-69d410661391 ResponseDesc=OK 2021-07-13T00:43:06.068Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f751554-bea9-4dd6-9ec9-04794b75a6fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:06.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:06.068Z InvocationID=dc1d5a6f-d3df-4809-ac01-9cec12c88776 2021-07-13T00:43:06.311Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f751554-bea9-4dd6-9ec9-04794b75a6fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:06.659Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0f751554-bea9-4dd6-9ec9-04794b75a6fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=591 EndTimestamp=2021-07-13T00:43:06.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:06.068Z InvocationID=6354efc3-a652-47dd-bdad-a0524b36662b ResponseDesc=OK 2021-07-13T00:43:07.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=25a8d230-096c-47c6-b2af-a068444093b9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:07.439Z InvocationID=cffd97d4-1610-49e8-921b-6e4088a8f5dc 2021-07-13T00:43:07.565Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=63ceca69-021a-432c-8193-73c73c129c44 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:07.565Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:07.565Z InvocationID=6ba5c870-da5f-404c-a62e-d6b91daff381 2021-07-13T00:43:07.656Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=25a8d230-096c-47c6-b2af-a068444093b9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:07.818Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=63ceca69-021a-432c-8193-73c73c129c44 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:07.857Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=25a8d230-096c-47c6-b2af-a068444093b9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=418 EndTimestamp=2021-07-13T00:43:07.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:07.439Z InvocationID=88cb4943-da4f-40bd-bf5c-5254f9f7460f ResponseDesc=OK 2021-07-13T00:43:08.376Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=63ceca69-021a-432c-8193-73c73c129c44 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=811 EndTimestamp=2021-07-13T00:43:08.376Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:07.565Z InvocationID=ec02afb2-9a0b-46bc-b958-3751ea318a3d ResponseDesc=OK 2021-07-13T00:43:08.873Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8562f2e8-f5ed-4ea8-bac8-1cd9ec09d7e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:08.873Z InvocationID=bcde7c7c-c676-4a9d-8641-87c1aac9d7e4 2021-07-13T00:43:09.114Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8562f2e8-f5ed-4ea8-bac8-1cd9ec09d7e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:09.359Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8562f2e8-f5ed-4ea8-bac8-1cd9ec09d7e0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:43:09.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:08.873Z InvocationID=e60dea0d-4d0c-483a-94dd-2e8bc8a27e01 ResponseDesc=OK 2021-07-13T00:43:09.560Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=048859c9-c4d6-4179-8ced-b77317b49b1c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:09.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:09.560Z InvocationID=05d82f90-ea38-4f5b-b10b-0ccb626e5057 2021-07-13T00:43:17.439Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=881bed17-2cc7-4c10-ba86-1d077904db2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:17.439Z InvocationID=0ba26056-2ac4-4f7e-a32c-96e718dbaa74 2021-07-13T00:43:18.873Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=84cc7dd8-d36e-4952-9b93-0b49fa73539b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:18.873Z InvocationID=e3819d32-2242-4ad7-884f-d4a3e7b4fb0e 2021-07-13T00:43:19.567Z [qtp817348612-74] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=048859c9-c4d6-4179-8ced-b77317b49b1c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:43:28.962Z [qtp817348612-71] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=84cc7dd8-d36e-4952-9b93-0b49fa73539b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:43:29.486Z [qtp817348612-56] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=881bed17-2cc7-4c10-ba86-1d077904db2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:43:29.563Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=881bed17-2cc7-4c10-ba86-1d077904db2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:43:29.570Z [qtp817348612-74] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=048859c9-c4d6-4179-8ced-b77317b49b1c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:43:32.442Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=67763b66-9442-4ae6-a10b-885b42e48146 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:32.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:32.442Z InvocationID=06e0814a-07e7-4531-8780-58f83aef5537 2021-07-13T00:43:32.720Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f71b4e7-3f51-44c9-9a80-bb14d53ab93b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:32.720Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:32.720Z InvocationID=f602c9b3-2ece-40e4-adb0-fb5068b979e6 2021-07-13T00:43:33.878Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8b3263d4-2cc3-4f1e-9f89-07b623c60fe3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:33.878Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:33.878Z InvocationID=acf1ac88-3392-4505-92be-82362b30f419 2021-07-13T00:43:34.058Z [qtp817348612-67] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8b3263d4-2cc3-4f1e-9f89-07b623c60fe3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:43:36.710Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1f4c76ec-8a98-41a4-aca7-7db04bfd8bce ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:43:36.710Z ElapsedTime=0 EndTimestamp=2021-07-13T00:43:36.710Z InvocationID=96151342-f71a-42e3-849c-72b9b28eee41 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:43:40.416Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9de6d7f4-7553-439c-afb8-f6962796df34 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:43:40.416Z ElapsedTime=0 EndTimestamp=2021-07-13T00:43:40.416Z InvocationID=04039611-3bbf-432d-8854-c06358bc82a2 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:43:40.463Z [qtp817348612-75] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9de6d7f4-7553-439c-afb8-f6962796df34 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:43:40.985Z [qtp817348612-71] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=84cc7dd8-d36e-4952-9b93-0b49fa73539b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:43:41.062Z [qtp817348612-71] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=84cc7dd8-d36e-4952-9b93-0b49fa73539b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:43:41.062Z [qtp817348612-71] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=84cc7dd8-d36e-4952-9b93-0b49fa73539b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:43:41.063Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=84cc7dd8-d36e-4952-9b93-0b49fa73539b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=22189 EndTimestamp=2021-07-13T00:43:41.062Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:18.873Z InvocationID=9cf96f54-6f4f-49c8-8d69-58db52774b28 ResponseDesc=Internal Server Error 2021-07-13T00:43:41.580Z [qtp817348612-56] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=881bed17-2cc7-4c10-ba86-1d077904db2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:43:41.580Z [qtp817348612-74] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=048859c9-c4d6-4179-8ced-b77317b49b1c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:43:41.580Z [qtp817348612-74] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=048859c9-c4d6-4179-8ced-b77317b49b1c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:43:41.580Z [qtp817348612-56] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=881bed17-2cc7-4c10-ba86-1d077904db2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:43:41.581Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=048859c9-c4d6-4179-8ced-b77317b49b1c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=32021 EndTimestamp=2021-07-13T00:43:41.581Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:09.560Z InvocationID=d0fd57e7-2823-40bc-a479-e0ef40b38c8e ResponseDesc=Internal Server Error 2021-07-13T00:43:41.581Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=881bed17-2cc7-4c10-ba86-1d077904db2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=24142 EndTimestamp=2021-07-13T00:43:41.581Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:17.439Z InvocationID=9cd11394-f174-40ae-88d4-f05ca3563c11 ResponseDesc=Internal Server Error 2021-07-13T00:43:44.486Z [qtp817348612-48] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=67763b66-9442-4ae6-a10b-885b42e48146 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:43:44.501Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=380ca3eb-fa25-47c7-b094-e28bea7e68ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:44.501Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:44.501Z InvocationID=dfeb78db-cb83-4b3d-afd2-16c32ca0645c 2021-07-13T00:43:44.563Z [qtp817348612-56] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=380ca3eb-fa25-47c7-b094-e28bea7e68ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:43:44.785Z [qtp817348612-51] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f71b4e7-3f51-44c9-9a80-bb14d53ab93b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:43:45.919Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1f4c76ec-8a98-41a4-aca7-7db04bfd8bce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:46.085Z [qtp817348612-67] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=8b3263d4-2cc3-4f1e-9f89-07b623c60fe3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:43:46.165Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=0f71b4e7-3f51-44c9-9a80-bb14d53ab93b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=13444 EndTimestamp=2021-07-13T00:43:46.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:32.720Z InvocationID=c7d22e0f-cb13-4c72-ae66-d8702b79d5b1 ResponseDesc=Internal Server Error 2021-07-13T00:43:47.361Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=8b3263d4-2cc3-4f1e-9f89-07b623c60fe3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=13483 EndTimestamp=2021-07-13T00:43:47.361Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:33.878Z InvocationID=a50156db-86bb-4d76-a599-5bcf1d50d422 ResponseDesc=Internal Server Error 2021-07-13T00:43:47.362Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=9de6d7f4-7553-439c-afb8-f6962796df34 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=6946 EndTimestamp=2021-07-13T00:43:47.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:40.416Z InvocationID=3d757703-7940-4ff4-966d-4099dbef2376 ResponseDesc=Internal Server Error 2021-07-13T00:43:47.362Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=380ca3eb-fa25-47c7-b094-e28bea7e68ee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2861 EndTimestamp=2021-07-13T00:43:47.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:44.501Z InvocationID=b4791be5-d334-47d7-a209-905cd5e72e1a ResponseDesc=Internal Server Error 2021-07-13T00:43:47.366Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8a19c951-42ee-48ab-b011-f7facee4ef2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:47.366Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:47.366Z InvocationID=fbcd08cc-480f-47ef-bc99-99df16e13537 2021-07-13T00:43:47.412Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=67763b66-9442-4ae6-a10b-885b42e48146 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=14970 EndTimestamp=2021-07-13T00:43:47.412Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:32.442Z InvocationID=a8bd4551-bb25-4d3a-88fc-d2a3a6e1b87b ResponseDesc=Internal Server Error 2021-07-13T00:43:47.413Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1f4c76ec-8a98-41a4-aca7-7db04bfd8bce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=10703 EndTimestamp=2021-07-13T00:43:47.413Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:36.710Z InvocationID=8240318f-6ab6-48c7-974d-8b7c216f9808 ResponseDesc=OK 2021-07-13T00:43:47.416Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7407b24e-ec0b-4e91-9705-24a3f2251cb3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:47.416Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:47.416Z InvocationID=8a55637f-f5a2-4c10-9e70-b307ab473bef 2021-07-13T00:43:47.557Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8a19c951-42ee-48ab-b011-f7facee4ef2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:47.612Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7407b24e-ec0b-4e91-9705-24a3f2251cb3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:48.357Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7407b24e-ec0b-4e91-9705-24a3f2251cb3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=941 EndTimestamp=2021-07-13T00:43:48.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:47.416Z InvocationID=2649eb7d-f72d-47ec-bc25-1967950c0286 ResponseDesc=OK 2021-07-13T00:43:48.361Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f4d93477-f387-417a-ac99-b1688330d23e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:48.361Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:48.361Z InvocationID=b20ba6d0-d3bf-4d5c-aa99-212ebba019fb 2021-07-13T00:43:48.512Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8a19c951-42ee-48ab-b011-f7facee4ef2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1146 EndTimestamp=2021-07-13T00:43:48.512Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:47.366Z InvocationID=80177313-2e84-4fad-9159-cc3665a463ee ResponseDesc=OK 2021-07-13T00:43:48.614Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f4d93477-f387-417a-ac99-b1688330d23e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:48.864Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f4d93477-f387-417a-ac99-b1688330d23e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=503 EndTimestamp=2021-07-13T00:43:48.864Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:48.361Z InvocationID=e6def373-9601-44f1-be15-4ccacafcbf85 ResponseDesc=OK 2021-07-13T00:43:48.873Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=df21cdc2-069c-439c-9325-b4b1e56bc1ae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:48.873Z InvocationID=76097d35-69aa-46d2-9946-4733bd09e609 2021-07-13T00:43:49.057Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=df21cdc2-069c-439c-9325-b4b1e56bc1ae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:49.167Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9c604e10-9a6c-4b8a-bcea-f42b99f33939 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:49.166Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:49.166Z InvocationID=8d7fbc97-cd52-413c-8fa2-5a4ada6239a6 2021-07-13T00:43:49.261Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9c604e10-9a6c-4b8a-bcea-f42b99f33939 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:50.058Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=df21cdc2-069c-439c-9325-b4b1e56bc1ae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1185 EndTimestamp=2021-07-13T00:43:50.058Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:48.873Z InvocationID=7e648b4a-7eb9-4116-90a4-47b6beaa3062 ResponseDesc=OK 2021-07-13T00:43:50.220Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9c604e10-9a6c-4b8a-bcea-f42b99f33939 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1054 EndTimestamp=2021-07-13T00:43:50.220Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:49.166Z InvocationID=48f32049-5b16-445b-9912-0dbed1562cb3 ResponseDesc=OK 2021-07-13T00:43:51.721Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c97422cb-e11b-4193-a31f-cff6ec468810 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:51.721Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:51.721Z InvocationID=d286a9ba-f4b5-4c5b-a61f-f3838f39bb58 2021-07-13T00:43:51.911Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c97422cb-e11b-4193-a31f-cff6ec468810 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:52.260Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c97422cb-e11b-4193-a31f-cff6ec468810 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=539 EndTimestamp=2021-07-13T00:43:52.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:51.721Z InvocationID=5e6e110d-8494-4b56-aaa8-fdf8d4da53c2 ResponseDesc=OK 2021-07-13T00:43:54.120Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bb97e7f4-71a5-4f27-a4d3-fbdd064c61aa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:54.120Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:54.120Z InvocationID=db0e10c7-dfaf-48d5-8296-4968b40c791a 2021-07-13T00:43:54.256Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bb97e7f4-71a5-4f27-a4d3-fbdd064c61aa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:55.758Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bb97e7f4-71a5-4f27-a4d3-fbdd064c61aa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1638 EndTimestamp=2021-07-13T00:43:55.758Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:54.120Z InvocationID=29033ff9-041d-48af-930f-545e82899282 ResponseDesc=OK 2021-07-13T00:43:56.970Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=89fc3f28-665d-4250-aef7-7007b85e032a ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:43:56.970Z ElapsedTime=0 EndTimestamp=2021-07-13T00:43:56.970Z InvocationID=93f07945-6626-425c-aa52-1b3cc98359cd PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:43:57.259Z [qtp817348612-78] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=89fc3f28-665d-4250-aef7-7007b85e032a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:57.440Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c92a7520-9143-40f0-bc78-1c3ece737eb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:57.439Z InvocationID=4ccc375f-6a1c-404f-9ff7-41eda3f3ca63 2021-07-13T00:43:57.625Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=89fc3f28-665d-4250-aef7-7007b85e032a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=655 EndTimestamp=2021-07-13T00:43:57.625Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:56.970Z InvocationID=3fdc0d67-6d02-45ea-86ab-da0b74cf7d25 ResponseDesc=OK 2021-07-13T00:43:57.817Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c92a7520-9143-40f0-bc78-1c3ece737eb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:58.060Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c92a7520-9143-40f0-bc78-1c3ece737eb4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=621 EndTimestamp=2021-07-13T00:43:58.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:57.439Z InvocationID=f1d5d578-f887-4cd6-a05f-7186ebbb49ae ResponseDesc=OK 2021-07-13T00:43:58.873Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2ace6e0a-4f01-4514-8c4e-35345c782f5b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:58.873Z InvocationID=010881de-6275-40b8-a5d0-910667cc1f9a 2021-07-13T00:43:59.157Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2ace6e0a-4f01-4514-8c4e-35345c782f5b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:43:59.757Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2ace6e0a-4f01-4514-8c4e-35345c782f5b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=884 EndTimestamp=2021-07-13T00:43:59.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:58.873Z InvocationID=6979a868-11fb-456c-81ec-1fe7b1584d79 ResponseDesc=OK 2021-07-13T00:43:59.838Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bb948693-a351-4563-adc9-22a134e37375 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:43:59.838Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:59.838Z InvocationID=03eb6f8c-6367-4127-91cb-fde5c7d071c9 2021-07-13T00:44:00.059Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bb948693-a351-4563-adc9-22a134e37375 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:00.418Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bb948693-a351-4563-adc9-22a134e37375 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=580 EndTimestamp=2021-07-13T00:44:00.418Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:43:59.838Z InvocationID=a1702efc-2d5c-433a-9b38-4ebdbbd18dda ResponseDesc=OK 2021-07-13T00:44:01.829Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0420b533-8e3c-40a2-a8cf-1fd3424dcc49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:01.829Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:01.829Z InvocationID=9740326f-7b77-488c-a7bd-67098af2cfbe 2021-07-13T00:44:02.462Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0420b533-8e3c-40a2-a8cf-1fd3424dcc49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:02.959Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0420b533-8e3c-40a2-a8cf-1fd3424dcc49 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1130 EndTimestamp=2021-07-13T00:44:02.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:01.829Z InvocationID=b87f3ce9-64bd-4364-9212-1166223783df ResponseDesc=OK 2021-07-13T00:44:04.724Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ffda5d5e-91b4-449a-bd9b-b2cb61ca0bd6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:04.723Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:04.723Z InvocationID=f1d3dfa9-e20d-4f1a-b571-a7d17969e3be 2021-07-13T00:44:04.858Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ffda5d5e-91b4-449a-bd9b-b2cb61ca0bd6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:05.369Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ffda5d5e-91b4-449a-bd9b-b2cb61ca0bd6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=646 EndTimestamp=2021-07-13T00:44:05.369Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:04.723Z InvocationID=07136724-ecb4-43cb-afc9-66adfc8a1607 ResponseDesc=OK 2021-07-13T00:44:07.441Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=76d54877-6245-47f4-be69-ccc17a338831 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:44:07.441Z ElapsedTime=0 EndTimestamp=2021-07-13T00:44:07.441Z InvocationID=1b99a94b-aecf-47b2-9b57-ad2f05cc8a28 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:44:07.858Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=76d54877-6245-47f4-be69-ccc17a338831 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:07.922Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=38cac947-666b-4977-a1ea-488f53341cfa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:07.922Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:07.922Z InvocationID=1f904f94-88f2-4780-9b00-693243652030 2021-07-13T00:44:08.218Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=76d54877-6245-47f4-be69-ccc17a338831 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=777 EndTimestamp=2021-07-13T00:44:08.218Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:07.441Z InvocationID=43bfa4dd-b0fb-46af-9279-4ddfdbcc560f ResponseDesc=OK 2021-07-13T00:44:08.221Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=38cac947-666b-4977-a1ea-488f53341cfa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:08.460Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=38cac947-666b-4977-a1ea-488f53341cfa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=538 EndTimestamp=2021-07-13T00:44:08.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:07.922Z InvocationID=a1c1f960-ebf5-4d79-9513-e5848d4e2ac9 ResponseDesc=OK 2021-07-13T00:44:08.873Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9dfa0833-fad7-4934-83d5-f8df7a15b07d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:08.873Z InvocationID=7ba01c63-459f-45ec-9e2f-fc773d34997b 2021-07-13T00:44:09.057Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9dfa0833-fad7-4934-83d5-f8df7a15b07d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:09.457Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9dfa0833-fad7-4934-83d5-f8df7a15b07d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=584 EndTimestamp=2021-07-13T00:44:09.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:08.873Z InvocationID=72437d48-0a55-4c87-8687-840e5b5cc5f3 ResponseDesc=OK 2021-07-13T00:44:09.865Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a1a1fc17-2892-4e18-9b52-78d80687d48d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:09.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:09.865Z InvocationID=07ddf77d-1a3f-499e-9a73-ebc842204bf6 2021-07-13T00:44:09.959Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a1a1fc17-2892-4e18-9b52-78d80687d48d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:10.313Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a1a1fc17-2892-4e18-9b52-78d80687d48d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=448 EndTimestamp=2021-07-13T00:44:10.313Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:09.865Z InvocationID=a481c2d7-e2d5-499e-aa9a-67a96338ace3 ResponseDesc=OK 2021-07-13T00:44:11.562Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=638e89f5-60f9-49a8-b8e6-4159230fc5f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:11.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:11.562Z InvocationID=8e85f3be-b671-4b26-bdd7-dd525c2cd0b6 2021-07-13T00:44:12.216Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=638e89f5-60f9-49a8-b8e6-4159230fc5f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:12.559Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=638e89f5-60f9-49a8-b8e6-4159230fc5f2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=997 EndTimestamp=2021-07-13T00:44:12.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:11.562Z InvocationID=27dc00ae-4d1b-4465-b33c-92e043cae11c ResponseDesc=OK 2021-07-13T00:44:13.664Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d7089bf7-d6d1-4306-bb3a-3d31ba12659c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:13.664Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:13.664Z InvocationID=a7f26c3f-b079-436d-8807-2614e17e4fc7 2021-07-13T00:44:13.864Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d7089bf7-d6d1-4306-bb3a-3d31ba12659c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:14.266Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d7089bf7-d6d1-4306-bb3a-3d31ba12659c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=602 EndTimestamp=2021-07-13T00:44:14.266Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:13.664Z InvocationID=b73f51c9-2c77-43e3-997c-6c1a4829168d ResponseDesc=OK 2021-07-13T00:44:15.379Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7256b6ec-73af-48ba-959a-bdfe0967610e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:15.379Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:15.379Z InvocationID=d35a934c-d463-4d27-a44e-b7c86187386a 2021-07-13T00:44:15.564Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7256b6ec-73af-48ba-959a-bdfe0967610e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:16.012Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7256b6ec-73af-48ba-959a-bdfe0967610e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=633 EndTimestamp=2021-07-13T00:44:16.012Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:15.379Z InvocationID=7d65a4d1-6892-4ed9-8c77-ffd9ac60204f ResponseDesc=OK 2021-07-13T00:44:17.264Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=84fe15fa-d6b2-4ee8-a657-924c38dcd3bf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:17.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:17.264Z InvocationID=2d2d5204-b150-4732-8a87-68b7bf56c374 2021-07-13T00:44:17.412Z [qtp817348612-78] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=84fe15fa-d6b2-4ee8-a657-924c38dcd3bf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:17.439Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=35e1da8e-8bc3-44ea-9752-747dea9e1b56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:17.439Z InvocationID=2784d18b-d05d-4e59-bbd3-4eb6c6986391 2021-07-13T00:44:17.657Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=35e1da8e-8bc3-44ea-9752-747dea9e1b56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:17.760Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=84fe15fa-d6b2-4ee8-a657-924c38dcd3bf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:44:17.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:17.264Z InvocationID=f52e2114-bbb0-4d86-94b3-5ad69ed016b2 ResponseDesc=OK 2021-07-13T00:44:18.058Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=35e1da8e-8bc3-44ea-9752-747dea9e1b56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=619 EndTimestamp=2021-07-13T00:44:18.058Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:17.439Z InvocationID=d55e3b3f-0a32-4238-b864-bc5d229645aa ResponseDesc=OK 2021-07-13T00:44:18.573Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=90be181b-ec3e-4f81-a8ef-24f0666ada10 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:18.573Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:18.573Z InvocationID=2e599a64-5d07-4b90-b83a-2e19d8b7253d 2021-07-13T00:44:18.662Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=90be181b-ec3e-4f81-a8ef-24f0666ada10 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:18.876Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fc667c82-2096-41ca-9f97-01b63c9bc033 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:18.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:18.876Z InvocationID=719a48cc-2260-41d7-a769-90f0d44c3bc9 2021-07-13T00:44:19.013Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=90be181b-ec3e-4f81-a8ef-24f0666ada10 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=440 EndTimestamp=2021-07-13T00:44:19.013Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:18.573Z InvocationID=896e9612-c17f-439c-b480-f4385c663910 ResponseDesc=OK 2021-07-13T00:44:19.114Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fc667c82-2096-41ca-9f97-01b63c9bc033 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:19.360Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fc667c82-2096-41ca-9f97-01b63c9bc033 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=484 EndTimestamp=2021-07-13T00:44:19.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:18.876Z InvocationID=f2eba70a-cfa9-466b-990b-536211aa539c ResponseDesc=OK 2021-07-13T00:44:20.662Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8e34851e-0664-46f9-9f29-68eba55fc075 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:20.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:20.662Z InvocationID=aa1ab76b-c191-47b0-b312-d5a5b500937f 2021-07-13T00:44:20.757Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8e34851e-0664-46f9-9f29-68eba55fc075 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:21.157Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8e34851e-0664-46f9-9f29-68eba55fc075 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:44:21.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:20.662Z InvocationID=056e7ab3-e8d3-4e46-ac07-944b66bdf9be ResponseDesc=OK 2021-07-13T00:44:22.066Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e1bb6425-7bb7-4f31-90e9-25934616e7b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:22.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:22.066Z InvocationID=1e3639f1-e439-4e1e-897d-3a8715ec5b85 2021-07-13T00:44:22.362Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e1bb6425-7bb7-4f31-90e9-25934616e7b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:22.720Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e1bb6425-7bb7-4f31-90e9-25934616e7b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=654 EndTimestamp=2021-07-13T00:44:22.720Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:22.066Z InvocationID=2f0e06cf-f02d-409d-9a43-0462f02b1848 ResponseDesc=OK 2021-07-13T00:44:23.667Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=440af727-536b-474a-8897-3f1049d40e06 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:23.666Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:23.666Z InvocationID=193bdca5-2321-4cf5-b755-d05ec3aa15fd 2021-07-13T00:44:23.933Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=440af727-536b-474a-8897-3f1049d40e06 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:24.160Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=440af727-536b-474a-8897-3f1049d40e06 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=493 EndTimestamp=2021-07-13T00:44:24.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:23.666Z InvocationID=ea7bea84-3e36-4eef-b49a-3a0abb93f1cb ResponseDesc=OK 2021-07-13T00:44:25.062Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0371f14d-d186-406d-adc0-8b2cddfb3bce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:25.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:25.062Z InvocationID=5a1d38ba-0677-488f-99f8-bd335334d6d5 2021-07-13T00:44:25.261Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0371f14d-d186-406d-adc0-8b2cddfb3bce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:25.957Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0371f14d-d186-406d-adc0-8b2cddfb3bce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=895 EndTimestamp=2021-07-13T00:44:25.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:25.062Z InvocationID=a5a32ee9-d80d-4ee9-afc3-979b0e8e5756 ResponseDesc=OK 2021-07-13T00:44:27.072Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=13ec62e8-e1ce-47c3-8d02-0348c2b220b6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:27.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:27.072Z InvocationID=031cd842-eafd-45a2-b22f-597d80a52994 2021-07-13T00:44:27.259Z [qtp817348612-78] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=13ec62e8-e1ce-47c3-8d02-0348c2b220b6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:27.442Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=204c7b40-c356-4299-b3ae-17b11a88ca8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:27.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:27.442Z InvocationID=e99c683e-5b5e-4020-b888-d89209751f3c 2021-07-13T00:44:27.712Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=204c7b40-c356-4299-b3ae-17b11a88ca8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:27.959Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=204c7b40-c356-4299-b3ae-17b11a88ca8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=517 EndTimestamp=2021-07-13T00:44:27.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:27.442Z InvocationID=a138a188-5160-4741-b3c9-13b544ecc128 ResponseDesc=OK 2021-07-13T00:44:28.022Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=13ec62e8-e1ce-47c3-8d02-0348c2b220b6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=950 EndTimestamp=2021-07-13T00:44:28.022Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:27.072Z InvocationID=241651ba-bf7d-4588-a1c2-a1f3481a8029 ResponseDesc=OK 2021-07-13T00:44:28.874Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f6841b40-3fbf-4d41-8d9a-5b2876b241c5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:28.874Z InvocationID=9e1bfcd0-3ebe-4caa-8c6b-899badb1161c 2021-07-13T00:44:29.056Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f6841b40-3fbf-4d41-8d9a-5b2876b241c5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:29.177Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8b185f83-f035-42af-ba01-ebcd48f55914 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:29.177Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:29.177Z InvocationID=c41f673e-6cbf-46d3-950a-023ed355ee2f 2021-07-13T00:44:29.359Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8b185f83-f035-42af-ba01-ebcd48f55914 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:29.468Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f6841b40-3fbf-4d41-8d9a-5b2876b241c5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=594 EndTimestamp=2021-07-13T00:44:29.468Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:28.874Z InvocationID=8d9167b5-99cb-4f11-a7b2-1195257eeb2e ResponseDesc=OK 2021-07-13T00:44:29.616Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8b185f83-f035-42af-ba01-ebcd48f55914 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:44:29.616Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:29.177Z InvocationID=7a3ec850-ac93-49ac-a793-4854258459ba ResponseDesc=OK 2021-07-13T00:44:30.371Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cc2e4ec3-7931-4760-95ef-80394a5dffcf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:30.371Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:30.371Z InvocationID=379a16a5-ed6c-4a5d-bfcb-d1410ddf5266 2021-07-13T00:44:31.011Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cc2e4ec3-7931-4760-95ef-80394a5dffcf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:31.259Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cc2e4ec3-7931-4760-95ef-80394a5dffcf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=888 EndTimestamp=2021-07-13T00:44:31.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:30.371Z InvocationID=dd7998d8-a72f-49f4-972e-018df3c9fb69 ResponseDesc=OK 2021-07-13T00:44:32.367Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=544d75f9-0979-4de7-975f-e6af9c9eefc1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:32.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:32.359Z InvocationID=dd2f1ee1-b711-4333-b4f1-1f6d1222ac95 2021-07-13T00:44:32.656Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=544d75f9-0979-4de7-975f-e6af9c9eefc1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:33.057Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=544d75f9-0979-4de7-975f-e6af9c9eefc1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=698 EndTimestamp=2021-07-13T00:44:33.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:32.359Z InvocationID=c978f751-ca12-46fd-a0d1-2658eb0091f9 ResponseDesc=OK 2021-07-13T00:44:34.566Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=afcbd41b-4a04-4c4e-95e6-3d0623f8f06b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:34.566Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:34.566Z InvocationID=056e2911-f3e0-45ba-aabb-b7a5c79e046f 2021-07-13T00:44:34.662Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=afcbd41b-4a04-4c4e-95e6-3d0623f8f06b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:35.016Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=afcbd41b-4a04-4c4e-95e6-3d0623f8f06b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=450 EndTimestamp=2021-07-13T00:44:35.016Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:34.566Z InvocationID=ca026176-a127-40d1-92d2-3f5baafe5c49 ResponseDesc=OK 2021-07-13T00:44:35.966Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ff95e3f9-ea0e-4294-be8e-f4323ff1245f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:35.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:35.966Z InvocationID=dfb2cc6e-74d3-4b47-a860-4c0d4641d804 2021-07-13T00:44:36.215Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ff95e3f9-ea0e-4294-be8e-f4323ff1245f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:36.460Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ff95e3f9-ea0e-4294-be8e-f4323ff1245f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=494 EndTimestamp=2021-07-13T00:44:36.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:35.966Z InvocationID=b7dd2e55-4897-4b68-bf06-054ab9e75d3c ResponseDesc=OK 2021-07-13T00:44:37.441Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a4ef28c5-1fbc-4632-adab-10152222a9d4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:37.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:37.441Z InvocationID=7e0283b1-3160-47e2-8ea7-1a5596b20832 2021-07-13T00:44:37.557Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a4ef28c5-1fbc-4632-adab-10152222a9d4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:37.957Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a4ef28c5-1fbc-4632-adab-10152222a9d4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=516 EndTimestamp=2021-07-13T00:44:37.957Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:37.441Z InvocationID=146287a1-2464-4ad6-ac6c-82c618f10ef4 ResponseDesc=OK 2021-07-13T00:44:38.016Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=840818a7-15f0-4d56-a4fb-e867e10fb2f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:38.016Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:38.016Z InvocationID=b727b499-9c76-4413-a221-f5363374b2bc 2021-07-13T00:44:38.159Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=840818a7-15f0-4d56-a4fb-e867e10fb2f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:38.512Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=840818a7-15f0-4d56-a4fb-e867e10fb2f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:44:38.512Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:38.016Z InvocationID=453a4373-15f4-43f2-a7e7-18faca913c7e ResponseDesc=OK 2021-07-13T00:44:38.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d04fd65b-9c22-408c-aebf-71e520cccd55 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:38.873Z InvocationID=edc604eb-8079-4779-9041-c35bfd9e389b 2021-07-13T00:44:39.014Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d04fd65b-9c22-408c-aebf-71e520cccd55 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:39.361Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=40258a48-fdfd-4560-938e-85c1c9c98f2e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:39.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:39.361Z InvocationID=bbf1a017-85c9-413c-b34a-6f0b3dc16a73 2021-07-13T00:44:40.056Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=40258a48-fdfd-4560-938e-85c1c9c98f2e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:40.163Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d04fd65b-9c22-408c-aebf-71e520cccd55 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1290 EndTimestamp=2021-07-13T00:44:40.163Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:38.873Z InvocationID=2ac6f032-5e5d-4515-9242-288a7d05017e ResponseDesc=OK 2021-07-13T00:44:40.457Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=40258a48-fdfd-4560-938e-85c1c9c98f2e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1096 EndTimestamp=2021-07-13T00:44:40.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:39.361Z InvocationID=5b7ffd2a-d7b4-4fec-92dd-77cdafcaefdc ResponseDesc=OK 2021-07-13T00:44:41.759Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=921dfe50-de98-4889-ae9c-c765a81c8a80 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:41.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:41.759Z InvocationID=a2aebee2-4a6a-4d50-ab9a-710fa8413ba6 2021-07-13T00:44:41.863Z [qtp817348612-67] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=921dfe50-de98-4889-ae9c-c765a81c8a80 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:42.236Z [qtp817348612-67] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=921dfe50-de98-4889-ae9c-c765a81c8a80 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=477 EndTimestamp=2021-07-13T00:44:42.236Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:41.759Z InvocationID=5a9426fe-d55e-4a20-961c-490d3a9b9062 ResponseDesc=OK 2021-07-13T00:44:43.164Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=57f7eaee-329a-4b21-b726-3a00926bf4b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:43.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:43.164Z InvocationID=2db8a910-cda7-4a75-af98-5efa227ce79a 2021-07-13T00:44:44.019Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=57f7eaee-329a-4b21-b726-3a00926bf4b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:44.259Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=57f7eaee-329a-4b21-b726-3a00926bf4b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1095 EndTimestamp=2021-07-13T00:44:44.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:43.164Z InvocationID=efa5e544-9119-4555-9f99-bbdf6b9f9b30 ResponseDesc=OK 2021-07-13T00:44:45.365Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b71c2288-aa5a-4ee6-a67d-f4261eb5f671 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:45.365Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:45.365Z InvocationID=93bb819a-c964-42d4-ab50-a8957897b130 2021-07-13T00:44:45.556Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b71c2288-aa5a-4ee6-a67d-f4261eb5f671 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:45.857Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b71c2288-aa5a-4ee6-a67d-f4261eb5f671 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=492 EndTimestamp=2021-07-13T00:44:45.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:45.365Z InvocationID=594f22cc-fb57-499c-90f5-9e2d003e183a ResponseDesc=OK 2021-07-13T00:44:46.964Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bcf13b0a-36a5-4e0d-a5bf-106749a6b620 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:46.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:46.964Z InvocationID=b9b75c1e-2d4f-4f4e-bb07-658ba8510299 2021-07-13T00:44:47.061Z [qtp817348612-78] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bcf13b0a-36a5-4e0d-a5bf-106749a6b620 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:47.365Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bcf13b0a-36a5-4e0d-a5bf-106749a6b620 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=400 EndTimestamp=2021-07-13T00:44:47.364Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:46.964Z InvocationID=0318d849-6d19-4bcc-ba66-af694c19c5b0 ResponseDesc=OK 2021-07-13T00:44:47.445Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1b88a5ae-2110-40a5-bd8d-21ab95308123 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:47.445Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:47.445Z InvocationID=270e5b58-d55e-4506-935a-f604420a0f0c 2021-07-13T00:44:47.712Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1b88a5ae-2110-40a5-bd8d-21ab95308123 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:47.960Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1b88a5ae-2110-40a5-bd8d-21ab95308123 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=515 EndTimestamp=2021-07-13T00:44:47.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:47.445Z InvocationID=b030fe39-ddce-4e30-8994-1b9eb7784d3d ResponseDesc=OK 2021-07-13T00:44:48.662Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e4d5eca7-8309-402d-a684-6112a26cc280 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:48.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:48.662Z InvocationID=d585739e-9f17-46c2-89e8-89e0ed7eedc5 2021-07-13T00:44:48.757Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e4d5eca7-8309-402d-a684-6112a26cc280 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:48.874Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d9c76e38-90aa-4e6a-9192-87a4c34a5aa0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:48.874Z InvocationID=dce54418-31b8-414d-96ff-15b237ea762e 2021-07-13T00:44:48.962Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d9c76e38-90aa-4e6a-9192-87a4c34a5aa0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:49.157Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e4d5eca7-8309-402d-a684-6112a26cc280 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:44:49.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:48.662Z InvocationID=b5e680b7-9ca1-43b4-9ea0-97806d55249e ResponseDesc=OK 2021-07-13T00:44:49.158Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d9c76e38-90aa-4e6a-9192-87a4c34a5aa0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=283 EndTimestamp=2021-07-13T00:44:49.157Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:48.874Z InvocationID=04b6dacf-68a0-4686-978f-ca071fdb26cf ResponseDesc=OK 2021-07-13T00:44:50.483Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=85a72117-d3dc-43b8-b655-15599c167bba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:50.483Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:50.483Z InvocationID=f1912779-4598-4207-ac15-ede7bbd23dbd 2021-07-13T00:44:51.377Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=85a72117-d3dc-43b8-b655-15599c167bba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:51.669Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=85a72117-d3dc-43b8-b655-15599c167bba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1186 EndTimestamp=2021-07-13T00:44:51.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:50.483Z InvocationID=40b19e0d-ef45-4183-9b4e-3300e5018a9a ResponseDesc=OK 2021-07-13T00:44:52.460Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ff37d6ac-4bed-45fa-aaf6-d72eccb01c6d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:52.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:52.460Z InvocationID=82403556-8a9f-4855-803b-2e2239a130c3 2021-07-13T00:44:52.557Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ff37d6ac-4bed-45fa-aaf6-d72eccb01c6d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:53.457Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ff37d6ac-4bed-45fa-aaf6-d72eccb01c6d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=997 EndTimestamp=2021-07-13T00:44:53.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:52.460Z InvocationID=9948d3c3-f11f-4d69-93f7-e03e84c788ee ResponseDesc=OK 2021-07-13T00:44:54.168Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8975f55e-d64e-4c60-a2d0-ebd442b3e60f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:54.167Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:54.167Z InvocationID=4cdd8627-a5a4-4ae7-8ce2-34a7a4e53d7b 2021-07-13T00:44:54.259Z [qtp817348612-78] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8975f55e-d64e-4c60-a2d0-ebd442b3e60f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:54.517Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8975f55e-d64e-4c60-a2d0-ebd442b3e60f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=350 EndTimestamp=2021-07-13T00:44:54.517Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:54.167Z InvocationID=b3222965-7540-4d32-88ab-c5c4cf3e7496 ResponseDesc=OK 2021-07-13T00:44:55.374Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ea89ddac-70b0-4fe0-b2af-c7fee6e8fcbf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:55.373Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:55.373Z InvocationID=a1f0ed56-cefe-4eb8-b6e2-7d8af8287647 2021-07-13T00:44:55.965Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ea89ddac-70b0-4fe0-b2af-c7fee6e8fcbf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:56.065Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ea89ddac-70b0-4fe0-b2af-c7fee6e8fcbf InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=692 EndTimestamp=2021-07-13T00:44:56.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:55.373Z InvocationID=6dcbabf0-a1ec-4742-916a-7905600a96fc ResponseDesc=OK 2021-07-13T00:44:57.182Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be1bff49-ba3f-4893-b426-115bc8500635 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:57.182Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:57.182Z InvocationID=41b27fd4-7c74-4b02-8d45-687c62897d8e 2021-07-13T00:44:57.357Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be1bff49-ba3f-4893-b426-115bc8500635 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:57.442Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6a67fb1f-acb3-40a8-a69f-0d2bac4ff74b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:57.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:57.442Z InvocationID=1bc34ca8-bb5f-42c4-bfc0-d7de7e52e52d 2021-07-13T00:44:57.559Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6a67fb1f-acb3-40a8-a69f-0d2bac4ff74b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:57.768Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be1bff49-ba3f-4893-b426-115bc8500635 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=586 EndTimestamp=2021-07-13T00:44:57.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:57.182Z InvocationID=6a11d023-4275-4b70-8e73-4d17a07ecc3d ResponseDesc=OK 2021-07-13T00:44:58.427Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6a67fb1f-acb3-40a8-a69f-0d2bac4ff74b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=985 EndTimestamp=2021-07-13T00:44:58.427Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:57.442Z InvocationID=7903de65-6386-43fa-bdf0-582ad049079a ResponseDesc=OK 2021-07-13T00:44:58.863Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a0bbc5a1-e938-4edc-becb-aea976c73d58 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:58.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:58.863Z InvocationID=09728cdd-ae4b-4a97-9b21-2d91bb665be2 2021-07-13T00:44:58.874Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eb459caf-dba3-4efa-afba-9cec85ecfd5b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:44:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:58.874Z InvocationID=335ab488-e86e-4131-a4bb-0d27222d03ae 2021-07-13T00:44:59.362Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eb459caf-dba3-4efa-afba-9cec85ecfd5b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:59.416Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a0bbc5a1-e938-4edc-becb-aea976c73d58 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:44:59.563Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eb459caf-dba3-4efa-afba-9cec85ecfd5b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=689 EndTimestamp=2021-07-13T00:44:59.563Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:58.874Z InvocationID=ccd5c953-aac2-4cd3-b27e-d7ec88d941a2 ResponseDesc=OK 2021-07-13T00:44:59.757Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a0bbc5a1-e938-4edc-becb-aea976c73d58 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=894 EndTimestamp=2021-07-13T00:44:59.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:44:58.863Z InvocationID=8a661b4f-b126-4d80-b80d-f8b77843a882 ResponseDesc=OK 2021-07-13T00:45:00.930Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9c7f7dd9-d44a-4a93-bf96-a31daa195976 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:00.930Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:00.930Z InvocationID=65ec7cda-af1e-4935-82b3-c09cb2b2b590 2021-07-13T00:45:01.062Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9c7f7dd9-d44a-4a93-bf96-a31daa195976 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:01.535Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9c7f7dd9-d44a-4a93-bf96-a31daa195976 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=605 EndTimestamp=2021-07-13T00:45:01.535Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:00.930Z InvocationID=fc27e617-a48c-4e53-84e1-136af66d199b ResponseDesc=OK 2021-07-13T00:45:03.432Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2c736a39-3644-43a9-b2ff-d86ffe76a1d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:03.432Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:03.432Z InvocationID=ef1c1344-fa15-4a72-b93a-d2df158eadd9 2021-07-13T00:45:03.567Z [qtp817348612-78] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2c736a39-3644-43a9-b2ff-d86ffe76a1d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:03.862Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2c736a39-3644-43a9-b2ff-d86ffe76a1d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=430 EndTimestamp=2021-07-13T00:45:03.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:03.432Z InvocationID=7db1e5b5-97c7-4616-8007-b804bb58e7e0 ResponseDesc=OK 2021-07-13T00:45:05.269Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=98df8911-e789-40d6-98fb-17be0e473b1e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:05.269Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:05.269Z InvocationID=21f5abb8-7f46-4a2b-a2cd-ae63b0124aaf 2021-07-13T00:45:05.458Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=98df8911-e789-40d6-98fb-17be0e473b1e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:05.957Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=98df8911-e789-40d6-98fb-17be0e473b1e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=688 EndTimestamp=2021-07-13T00:45:05.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:05.269Z InvocationID=2b92f9c3-370d-4aa4-8505-d615f50c9bf0 ResponseDesc=OK 2021-07-13T00:45:07.430Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=54ec5752-6fd0-417a-84b8-c340c65ca4b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:07.430Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:07.430Z InvocationID=69d9aae1-b1e8-4634-9dca-11174fcb8b5a 2021-07-13T00:45:07.439Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=89ddf958-be0a-42a2-9776-90349a37f563 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:07.439Z InvocationID=26dd227e-4c71-4475-823e-e7f89bdc926d 2021-07-13T00:45:07.556Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=89ddf958-be0a-42a2-9776-90349a37f563 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:07.766Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=54ec5752-6fd0-417a-84b8-c340c65ca4b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:07.970Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=89ddf958-be0a-42a2-9776-90349a37f563 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=531 EndTimestamp=2021-07-13T00:45:07.970Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:07.439Z InvocationID=16d4fb5f-0ba4-4037-8ff5-2307751c18ae ResponseDesc=OK 2021-07-13T00:45:08.064Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=54ec5752-6fd0-417a-84b8-c340c65ca4b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=633 EndTimestamp=2021-07-13T00:45:08.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:07.430Z InvocationID=943a1ffe-0330-4f37-b81f-06d3999fb1d7 ResponseDesc=OK 2021-07-13T00:45:08.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9ed3f7f0-2b11-4787-9b77-9d99e57cbd37 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:08.873Z InvocationID=5add1d33-41db-49dc-9787-4093f6bb689b 2021-07-13T00:45:09.159Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9ed3f7f0-2b11-4787-9b77-9d99e57cbd37 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:09.560Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=676ea8d1-a799-46b7-b2eb-2e934748231a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:09.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:09.559Z InvocationID=be4cb296-316d-467d-b982-4e374e4634e7 2021-07-13T00:45:09.657Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9ed3f7f0-2b11-4787-9b77-9d99e57cbd37 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=784 EndTimestamp=2021-07-13T00:45:09.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:08.873Z InvocationID=5eca60f9-0b14-437c-9381-43e865cdd63f ResponseDesc=OK 2021-07-13T00:45:09.659Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=676ea8d1-a799-46b7-b2eb-2e934748231a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:10.223Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=676ea8d1-a799-46b7-b2eb-2e934748231a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=664 EndTimestamp=2021-07-13T00:45:10.223Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:09.559Z InvocationID=74f1377f-a382-4663-941d-51420843795f ResponseDesc=OK 2021-07-13T00:45:11.264Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=44e01cfd-d756-406e-857f-fcc2117554b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:11.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:11.264Z InvocationID=85036d27-81b6-4332-bad3-fce9d51d7b66 2021-07-13T00:45:11.861Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=44e01cfd-d756-406e-857f-fcc2117554b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:12.059Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=44e01cfd-d756-406e-857f-fcc2117554b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=795 EndTimestamp=2021-07-13T00:45:12.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:11.264Z InvocationID=43b31e54-f5a8-4eec-ae40-d29efa03551b ResponseDesc=OK 2021-07-13T00:45:13.769Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cbac5d7f-d817-4695-9b59-487aee4e5016 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:13.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:13.769Z InvocationID=85fb92e8-a734-4a23-8b49-f0a958ea31f7 2021-07-13T00:45:13.957Z [qtp817348612-78] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cbac5d7f-d817-4695-9b59-487aee4e5016 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:14.563Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cbac5d7f-d817-4695-9b59-487aee4e5016 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=794 EndTimestamp=2021-07-13T00:45:14.563Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:13.769Z InvocationID=77cc6cb9-dd08-4477-a04f-452794946ba6 ResponseDesc=OK 2021-07-13T00:45:15.970Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8e36bcb3-c8c8-4819-9823-a94956d217b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:15.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:15.970Z InvocationID=4acdc761-37b2-4e3c-a79d-4f52b3363348 2021-07-13T00:45:16.059Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8e36bcb3-c8c8-4819-9823-a94956d217b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:16.420Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8e36bcb3-c8c8-4819-9823-a94956d217b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=450 EndTimestamp=2021-07-13T00:45:16.420Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:15.970Z InvocationID=2ccdf2d5-8394-4285-b4fe-2f37747126e3 ResponseDesc=OK 2021-07-13T00:45:17.439Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=af545eac-575e-4eba-83ff-fc44cf12491b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:17.439Z InvocationID=510afb8a-db82-4274-a3c8-c3d5133a3839 2021-07-13T00:45:17.721Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=af545eac-575e-4eba-83ff-fc44cf12491b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:17.761Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b39fc02a-ce49-4c45-a69c-bc2c8fad7740 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:17.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:17.761Z InvocationID=b1ded693-1893-46d3-beea-446787bf75ff 2021-07-13T00:45:17.957Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b39fc02a-ce49-4c45-a69c-bc2c8fad7740 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:18.874Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9af4ccd5-fbf8-40fd-ba8f-d657cd710deb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:18.874Z InvocationID=5c1c1177-1f98-4e09-9086-803f18d3b13f 2021-07-13T00:45:18.961Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=af545eac-575e-4eba-83ff-fc44cf12491b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1522 EndTimestamp=2021-07-13T00:45:18.961Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:17.439Z InvocationID=ae9e2874-1d4d-4a1d-9555-c3c77e0b9a07 ResponseDesc=OK 2021-07-13T00:45:19.159Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9af4ccd5-fbf8-40fd-ba8f-d657cd710deb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:19.261Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b39fc02a-ce49-4c45-a69c-bc2c8fad7740 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1500 EndTimestamp=2021-07-13T00:45:19.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:17.761Z InvocationID=5f7e8ca1-dfb7-49c1-9802-04a7b8759d17 ResponseDesc=OK 2021-07-13T00:45:19.514Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9af4ccd5-fbf8-40fd-ba8f-d657cd710deb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=639 EndTimestamp=2021-07-13T00:45:19.513Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:18.874Z InvocationID=69f31b6f-340e-4905-bc1c-42375d689c44 ResponseDesc=OK 2021-07-13T00:45:20.375Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ae8798ab-8796-4599-9466-a5157bb261d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:20.374Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:20.374Z InvocationID=53e87f83-5739-4a15-bf6d-06d019966951 2021-07-13T00:45:20.621Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ae8798ab-8796-4599-9466-a5157bb261d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:22.465Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ae8798ab-8796-4599-9466-a5157bb261d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2091 EndTimestamp=2021-07-13T00:45:22.465Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:20.374Z InvocationID=51c6ff1c-614c-425f-ab10-12deb1d1c0ba ResponseDesc=OK 2021-07-13T00:45:23.587Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4f45d88c-8194-4867-9a4b-7fada360887a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:23.587Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:23.587Z InvocationID=9f140209-db97-462e-b59b-0cf69e8cf19a 2021-07-13T00:45:23.959Z [qtp817348612-78] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4f45d88c-8194-4867-9a4b-7fada360887a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:24.471Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4f45d88c-8194-4867-9a4b-7fada360887a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=884 EndTimestamp=2021-07-13T00:45:24.471Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:23.587Z InvocationID=70158ea2-cb73-4741-8caa-3313200aea4f ResponseDesc=OK 2021-07-13T00:45:25.661Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e3e7569b-ff95-4be8-8543-8638580936d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:25.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:25.661Z InvocationID=8a65ee4f-3be9-49f8-a218-d2e29bd61410 2021-07-13T00:45:25.759Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e3e7569b-ff95-4be8-8543-8638580936d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:25.963Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e3e7569b-ff95-4be8-8543-8638580936d3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=302 EndTimestamp=2021-07-13T00:45:25.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:25.661Z InvocationID=a165382e-95fa-40b0-a3e4-76b95b3beba4 ResponseDesc=OK 2021-07-13T00:45:27.373Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9ed98f3b-7a78-465d-a8f2-df2ef1772a96 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:27.372Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:27.372Z InvocationID=10d8b869-8a6a-4d0b-a6e1-482c26fa546b 2021-07-13T00:45:27.440Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4d89b0fe-fa31-4d10-a3e7-21eac20a3618 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:27.440Z InvocationID=803d4df4-a285-4004-b28a-3e8358d149c4 2021-07-13T00:45:28.461Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4d89b0fe-fa31-4d10-a3e7-21eac20a3618 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:28.517Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9ed98f3b-7a78-465d-a8f2-df2ef1772a96 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:28.663Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4d89b0fe-fa31-4d10-a3e7-21eac20a3618 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1223 EndTimestamp=2021-07-13T00:45:28.663Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:27.440Z InvocationID=afc3920a-140f-444f-b10a-ea41a96b9783 ResponseDesc=OK 2021-07-13T00:45:28.875Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cfc6e2f0-a6fa-44c3-8adb-84fda8a36f65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:28.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:28.875Z InvocationID=ec1f257f-bcfc-41de-9079-19e930433d23 2021-07-13T00:45:29.160Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cfc6e2f0-a6fa-44c3-8adb-84fda8a36f65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:29.357Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9ed98f3b-7a78-465d-a8f2-df2ef1772a96 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1985 EndTimestamp=2021-07-13T00:45:29.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:27.372Z InvocationID=9980a964-b603-4039-8b97-2e1d66f595df ResponseDesc=OK 2021-07-13T00:45:29.517Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cfc6e2f0-a6fa-44c3-8adb-84fda8a36f65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=642 EndTimestamp=2021-07-13T00:45:29.517Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:28.875Z InvocationID=9e9fc8d1-d5ff-455e-b7f5-4e436d9c264e ResponseDesc=OK 2021-07-13T00:45:30.424Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fd609d45-020e-471b-aab0-dbd9dfcde5c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:30.424Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:30.424Z InvocationID=1283bdb6-7896-4a5d-aade-a199b815c634 2021-07-13T00:45:30.615Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fd609d45-020e-471b-aab0-dbd9dfcde5c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:30.859Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fd609d45-020e-471b-aab0-dbd9dfcde5c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=435 EndTimestamp=2021-07-13T00:45:30.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:30.424Z InvocationID=670138dc-8ef5-4914-922f-2d5c6d79ba37 ResponseDesc=OK 2021-07-13T00:45:32.937Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cd7fc676-8a87-4da3-86e4-49bfe49b3ba5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:32.937Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:32.937Z InvocationID=22287d0e-8660-4b27-bc2c-105ad4a93953 2021-07-13T00:45:33.057Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cd7fc676-8a87-4da3-86e4-49bfe49b3ba5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:33.557Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cd7fc676-8a87-4da3-86e4-49bfe49b3ba5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=620 EndTimestamp=2021-07-13T00:45:33.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:32.937Z InvocationID=ff8e063c-506f-44d4-97c4-744c3624f3e6 ResponseDesc=OK 2021-07-13T00:45:36.074Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=85938cab-89e8-49eb-8eba-efab5016a932 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:36.074Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:36.074Z InvocationID=47b113a0-e507-4426-8e2d-adb858fa0ca4 2021-07-13T00:45:36.259Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=85938cab-89e8-49eb-8eba-efab5016a932 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:36.613Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=85938cab-89e8-49eb-8eba-efab5016a932 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=539 EndTimestamp=2021-07-13T00:45:36.613Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:36.074Z InvocationID=40d92989-c429-4c7c-b273-06cf7d5b4739 ResponseDesc=OK 2021-07-13T00:45:37.441Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f0ee988d-528f-412b-ba40-9f01382232fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:37.440Z InvocationID=b36dfa8b-79de-45a3-ac09-2eec379609ef 2021-07-13T00:45:37.462Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f0ee988d-528f-412b-ba40-9f01382232fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:37.561Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f0ee988d-528f-412b-ba40-9f01382232fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=121 EndTimestamp=2021-07-13T00:45:37.561Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:37.440Z InvocationID=b23b10ee-4d67-41e7-a566-1dc6b2a1693d ResponseDesc=OK 2021-07-13T00:45:38.875Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ab442247-d4c2-4d59-84d8-2c1986b6acd1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:38.874Z InvocationID=4559f40f-2b35-4c64-b4f2-33a7ee983973 2021-07-13T00:45:39.066Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3c76f565-0918-4f8a-8973-f8dd3deaa264 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:39.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:39.066Z InvocationID=3c0cc3d7-603a-4872-a09e-b4210fcd584f 2021-07-13T00:45:39.464Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ab442247-d4c2-4d59-84d8-2c1986b6acd1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:39.482Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3c76f565-0918-4f8a-8973-f8dd3deaa264 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:40.657Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ab442247-d4c2-4d59-84d8-2c1986b6acd1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1783 EndTimestamp=2021-07-13T00:45:40.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:38.874Z InvocationID=77ac4ee0-d78e-43e4-bfce-e775f7bf3574 ResponseDesc=OK 2021-07-13T00:45:40.771Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3c76f565-0918-4f8a-8973-f8dd3deaa264 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1705 EndTimestamp=2021-07-13T00:45:40.771Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:39.066Z InvocationID=2c9dafb6-1bc1-4225-83ad-05d882d535c0 ResponseDesc=OK 2021-07-13T00:45:41.966Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9073c77-939c-48e2-88e9-010237219fe5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:41.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:41.965Z InvocationID=004df695-cdc0-40b4-aee8-a7a20ed97c03 2021-07-13T00:45:42.075Z [qtp817348612-78] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b9073c77-939c-48e2-88e9-010237219fe5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:42.260Z [qtp817348612-78] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b9073c77-939c-48e2-88e9-010237219fe5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=295 EndTimestamp=2021-07-13T00:45:42.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:41.965Z InvocationID=cb521e4e-d342-48b8-8d31-4ee65fd9d634 ResponseDesc=OK 2021-07-13T00:45:44.967Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d7315e30-76ad-4f86-92be-d933184e6fee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:44.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:44.967Z InvocationID=e9e53503-1161-430c-9711-93dae3ec68b6 2021-07-13T00:45:45.156Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d7315e30-76ad-4f86-92be-d933184e6fee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:45.364Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d7315e30-76ad-4f86-92be-d933184e6fee InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=397 EndTimestamp=2021-07-13T00:45:45.364Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:44.967Z InvocationID=3e7589c6-604e-44e8-9bf5-197c2d3b2c42 ResponseDesc=OK 2021-07-13T00:45:47.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=73dfb99d-640d-49c9-97cb-736b59775fca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:47.440Z InvocationID=225e0b35-882c-4e00-90b8-8a55a0632217 2021-07-13T00:45:47.464Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=73dfb99d-640d-49c9-97cb-736b59775fca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:47.977Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=73dfb99d-640d-49c9-97cb-736b59775fca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=537 EndTimestamp=2021-07-13T00:45:47.977Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:47.440Z InvocationID=77b18aec-65b4-4234-8166-e18e97a2fd29 ResponseDesc=OK 2021-07-13T00:45:48.073Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=35b7c6bf-33f1-4de7-bffc-e717b11eb7d4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:48.073Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:48.073Z InvocationID=e6c14775-8f97-4d44-95f4-a207f8a533e2 2021-07-13T00:45:48.168Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=35b7c6bf-33f1-4de7-bffc-e717b11eb7d4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:48.265Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=35b7c6bf-33f1-4de7-bffc-e717b11eb7d4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=192 EndTimestamp=2021-07-13T00:45:48.265Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:48.073Z InvocationID=1b584903-457a-4370-a2ad-254fe6e860c9 ResponseDesc=OK 2021-07-13T00:45:48.873Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=925eeaf2-39f4-46c3-bcf5-119d55497f30 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:48.873Z InvocationID=baafaca8-db59-47df-a807-1bfc5f9d979a 2021-07-13T00:45:49.257Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=925eeaf2-39f4-46c3-bcf5-119d55497f30 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:49.371Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=925eeaf2-39f4-46c3-bcf5-119d55497f30 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=498 EndTimestamp=2021-07-13T00:45:49.371Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:48.873Z InvocationID=671b8cb9-138a-445c-8dcf-edb44c0fea0f ResponseDesc=OK 2021-07-13T00:45:50.972Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5c47123c-3dc1-4034-ad6e-79c757bdc247 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:50.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:50.972Z InvocationID=3d7b81a7-3acf-438a-9968-bed339ed1a0c 2021-07-13T00:45:51.082Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5c47123c-3dc1-4034-ad6e-79c757bdc247 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:51.380Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5c47123c-3dc1-4034-ad6e-79c757bdc247 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=408 EndTimestamp=2021-07-13T00:45:51.380Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:50.972Z InvocationID=d0acb787-56ad-4e68-b7e5-3d520c35240f ResponseDesc=OK 2021-07-13T00:45:53.662Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0ff4f520-864b-4922-a9e4-edfbdb68a8fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:53.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:53.662Z InvocationID=44c0084e-7414-455b-8003-da1c4335b922 2021-07-13T00:45:54.062Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0ff4f520-864b-4922-a9e4-edfbdb68a8fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:54.171Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0ff4f520-864b-4922-a9e4-edfbdb68a8fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=508 EndTimestamp=2021-07-13T00:45:54.170Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:53.662Z InvocationID=44b40e44-58b4-4d6c-bbbe-6d3807421dd5 ResponseDesc=OK 2021-07-13T00:45:56.563Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce2bfbda-c812-4f53-b868-faf31c3e7e46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:56.563Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:56.563Z InvocationID=696bc8d6-0bfc-4aca-8a2c-f98ba9c04e44 2021-07-13T00:45:56.657Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce2bfbda-c812-4f53-b868-faf31c3e7e46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:57.439Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=97e4cb78-9d01-4d00-ac41-c9ffdcc0ccac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:57.439Z InvocationID=720cfca0-afdf-4875-901e-0a2e94cc8fad 2021-07-13T00:45:57.559Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=97e4cb78-9d01-4d00-ac41-c9ffdcc0ccac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:57.566Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ce2bfbda-c812-4f53-b868-faf31c3e7e46 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1003 EndTimestamp=2021-07-13T00:45:57.566Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:56.563Z InvocationID=59bedff7-2d2d-4387-8178-29d1a99b3798 ResponseDesc=OK 2021-07-13T00:45:57.761Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=97e4cb78-9d01-4d00-ac41-c9ffdcc0ccac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=321 EndTimestamp=2021-07-13T00:45:57.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:57.439Z InvocationID=e7743364-849c-4d5e-a8dd-237b0eb0ea29 ResponseDesc=OK 2021-07-13T00:45:58.875Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4fee7d2b-3f70-4a87-a6a1-de37b04a736a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:58.874Z InvocationID=2be91a92-ed23-4c3e-bfaf-0ac1f61021fb 2021-07-13T00:45:59.019Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4fee7d2b-3f70-4a87-a6a1-de37b04a736a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:45:59.260Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4fee7d2b-3f70-4a87-a6a1-de37b04a736a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=386 EndTimestamp=2021-07-13T00:45:59.260Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:58.874Z InvocationID=3a823320-996e-4dc5-9540-79fbbd42af29 ResponseDesc=OK 2021-07-13T00:45:59.974Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ad419a65-221c-4edd-a167-55d0e6065276 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:45:59.974Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:59.974Z InvocationID=bdbfc61e-dfdd-4e70-a2be-f3593ba70eef 2021-07-13T00:46:00.163Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ad419a65-221c-4edd-a167-55d0e6065276 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:00.268Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ad419a65-221c-4edd-a167-55d0e6065276 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=294 EndTimestamp=2021-07-13T00:46:00.268Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:45:59.974Z InvocationID=726fce9c-784b-4e65-8dc4-1d4056e1fb79 ResponseDesc=OK 2021-07-13T00:46:02.580Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=375a8f82-e979-474f-9c4c-20ae1fb7732a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:02.580Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:02.580Z InvocationID=ca926fdd-b0cf-40e0-898c-76d65765f63c 2021-07-13T00:46:02.766Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=375a8f82-e979-474f-9c4c-20ae1fb7732a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:03.013Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=375a8f82-e979-474f-9c4c-20ae1fb7732a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=432 EndTimestamp=2021-07-13T00:46:03.012Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:02.580Z InvocationID=a0838e91-ea24-4fe2-b879-28977eab7809 ResponseDesc=OK 2021-07-13T00:46:05.765Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4583b3cd-a77f-4105-8021-628df91ef209 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:05.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:05.765Z InvocationID=17112ed6-c9d8-417d-b1c3-3eb6e7c59c44 2021-07-13T00:46:06.374Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4583b3cd-a77f-4105-8021-628df91ef209 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:06.861Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4583b3cd-a77f-4105-8021-628df91ef209 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1096 EndTimestamp=2021-07-13T00:46:06.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:05.765Z InvocationID=7bc43635-6963-4de0-9345-de4a586597de ResponseDesc=OK 2021-07-13T00:46:07.440Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=06f3bae3-5658-4241-ab84-111dbbce7993 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:07.440Z InvocationID=abbbcaa6-6e82-46ce-b517-a31c17204044 2021-07-13T00:46:07.656Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=06f3bae3-5658-4241-ab84-111dbbce7993 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:08.558Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=06f3bae3-5658-4241-ab84-111dbbce7993 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1117 EndTimestamp=2021-07-13T00:46:08.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:07.440Z InvocationID=a2f7f4e8-8da2-4189-85ed-0994f8afef4d ResponseDesc=OK 2021-07-13T00:46:08.774Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=614c25fa-2778-4242-a484-06f4bf969158 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:08.774Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:08.774Z InvocationID=81ef03dd-7b00-4993-a7d3-5f97e114db73 2021-07-13T00:46:08.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=50a06252-56f1-4176-9c77-bbb022d37792 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:08.873Z InvocationID=8334e694-85bd-4bb5-836e-0ba62d301c34 2021-07-13T00:46:08.960Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=614c25fa-2778-4242-a484-06f4bf969158 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:08.971Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=50a06252-56f1-4176-9c77-bbb022d37792 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:09.763Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=614c25fa-2778-4242-a484-06f4bf969158 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=989 EndTimestamp=2021-07-13T00:46:09.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:08.774Z InvocationID=354ef5d0-9915-414c-8264-3b1b61e08ffa ResponseDesc=OK 2021-07-13T00:46:09.813Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=50a06252-56f1-4176-9c77-bbb022d37792 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=940 EndTimestamp=2021-07-13T00:46:09.813Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:08.873Z InvocationID=106d6ba9-ec75-4758-9a3b-ee1546981daa ResponseDesc=OK 2021-07-13T00:46:11.930Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d20881e0-e79b-4cd2-827f-0f13206dce6a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:11.930Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:11.930Z InvocationID=8478be5f-9b14-4302-a830-d0b0f1294f7a 2021-07-13T00:46:12.059Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d20881e0-e79b-4cd2-827f-0f13206dce6a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:17.440Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f57ac14c-8c95-4013-b41b-ee26db26d1d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:17.439Z InvocationID=5a1e839f-47cb-4ec6-bd30-fff1f2c33026 2021-07-13T00:46:17.457Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d20881e0-e79b-4cd2-827f-0f13206dce6a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5527 EndTimestamp=2021-07-13T00:46:17.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:11.930Z InvocationID=b79bf5f2-871b-4cd2-ab40-048b362d2f3f ResponseDesc=OK 2021-07-13T00:46:17.559Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f57ac14c-8c95-4013-b41b-ee26db26d1d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:17.871Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f57ac14c-8c95-4013-b41b-ee26db26d1d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=432 EndTimestamp=2021-07-13T00:46:17.871Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:17.439Z InvocationID=aa6450c1-0ff7-49e9-b6f7-f28cf69ceaf4 ResponseDesc=OK 2021-07-13T00:46:18.158Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3e976d7d-4961-46c3-a10c-018365693923 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:18.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:18.158Z InvocationID=272224e5-d1f6-40e2-9644-c9c2676e7f89 2021-07-13T00:46:18.366Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3e976d7d-4961-46c3-a10c-018365693923 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:18.583Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3e976d7d-4961-46c3-a10c-018365693923 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=425 EndTimestamp=2021-07-13T00:46:18.583Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:18.158Z InvocationID=7ccfb4f8-832d-463e-a9fc-a6007c90d81d ResponseDesc=OK 2021-07-13T00:46:18.873Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=74cc57dc-a323-4a8a-8e93-d015898741f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:18.873Z InvocationID=0d61fa73-f9c5-4b81-be76-8f18f724ad85 2021-07-13T00:46:19.156Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=74cc57dc-a323-4a8a-8e93-d015898741f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:19.459Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=74cc57dc-a323-4a8a-8e93-d015898741f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=586 EndTimestamp=2021-07-13T00:46:19.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:18.873Z InvocationID=7466b162-f436-476b-9ad3-9fd008dacd25 ResponseDesc=OK 2021-07-13T00:46:19.869Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b0ce1f6f-636d-468e-bea6-cf1ee3aeca73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:19.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:19.869Z InvocationID=46e4b7fa-8d91-4e57-a07e-8e4e04fa67f5 2021-07-13T00:46:20.058Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b0ce1f6f-636d-468e-bea6-cf1ee3aeca73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:20.634Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b0ce1f6f-636d-468e-bea6-cf1ee3aeca73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=765 EndTimestamp=2021-07-13T00:46:20.634Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:19.869Z InvocationID=6ced839c-98d0-43dc-a342-d0031f944a10 ResponseDesc=OK 2021-07-13T00:46:21.527Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=87d63d14-c909-41bb-9689-5e0b5809ad01 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:21.527Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:21.527Z InvocationID=58d32332-5b14-4dba-88da-2e6344e0b9e6 2021-07-13T00:46:21.662Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=87d63d14-c909-41bb-9689-5e0b5809ad01 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:21.863Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=87d63d14-c909-41bb-9689-5e0b5809ad01 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=335 EndTimestamp=2021-07-13T00:46:21.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:21.527Z InvocationID=b597bd71-9f69-4648-84aa-6ceb1e1ee637 ResponseDesc=OK 2021-07-13T00:46:23.761Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d3d3c672-35e1-4881-b9a8-fa29d8933a96 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:23.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:23.761Z InvocationID=60e8fdaf-666a-49cb-befe-c81336c5b61e 2021-07-13T00:46:23.857Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d3d3c672-35e1-4881-b9a8-fa29d8933a96 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:24.169Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d3d3c672-35e1-4881-b9a8-fa29d8933a96 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=408 EndTimestamp=2021-07-13T00:46:24.169Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:23.761Z InvocationID=b05e20f1-283f-4dfd-a8e4-038b42c81b53 ResponseDesc=OK 2021-07-13T00:46:26.764Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9a81190d-b5e2-4597-a966-30f5ab5f1589 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:26.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:26.764Z InvocationID=c542c0ca-27d2-4346-bd23-8b34f28e21c4 2021-07-13T00:46:26.860Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9a81190d-b5e2-4597-a966-30f5ab5f1589 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:27.223Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9a81190d-b5e2-4597-a966-30f5ab5f1589 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=459 EndTimestamp=2021-07-13T00:46:27.223Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:26.764Z InvocationID=f542d48d-8ab7-4e60-976c-604128f553b1 ResponseDesc=OK 2021-07-13T00:46:27.439Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b4a373f5-d7a6-45da-bee3-7bfb3fee9246 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:27.439Z InvocationID=45b27af1-9079-4edf-b783-975bf338b394 2021-07-13T00:46:27.711Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b4a373f5-d7a6-45da-bee3-7bfb3fee9246 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:27.959Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b4a373f5-d7a6-45da-bee3-7bfb3fee9246 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=520 EndTimestamp=2021-07-13T00:46:27.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:27.439Z InvocationID=cc57bea6-efb0-42ce-8b54-412eebd09759 ResponseDesc=OK 2021-07-13T00:46:28.874Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=605d2053-5a4e-436e-9339-004a12f14d90 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:28.874Z InvocationID=218583f4-0f56-45bd-ae05-9d5359b8f3b6 2021-07-13T00:46:29.156Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=605d2053-5a4e-436e-9339-004a12f14d90 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:29.557Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=605d2053-5a4e-436e-9339-004a12f14d90 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=683 EndTimestamp=2021-07-13T00:46:29.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:28.874Z InvocationID=339d5a2c-fd43-415c-89c0-1155ab2cada5 ResponseDesc=OK 2021-07-13T00:46:29.970Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=27492374-67de-4238-8e17-bde08c01ee51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:29.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:29.970Z InvocationID=a66e7888-ab0d-442e-a022-c55f7cc4391f 2021-07-13T00:46:30.162Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=27492374-67de-4238-8e17-bde08c01ee51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:30.364Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=27492374-67de-4238-8e17-bde08c01ee51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=394 EndTimestamp=2021-07-13T00:46:30.364Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:29.970Z InvocationID=65e70694-a128-4a82-be0a-9944028cc5d9 ResponseDesc=OK 2021-07-13T00:46:32.914Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7085c83c-d1c7-4426-be0d-339921a56d2b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:32.914Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:32.914Z InvocationID=d4bee14a-052c-45c4-a69f-dbc7996a5cfc 2021-07-13T00:46:34.170Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7085c83c-d1c7-4426-be0d-339921a56d2b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:34.268Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7085c83c-d1c7-4426-be0d-339921a56d2b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1354 EndTimestamp=2021-07-13T00:46:34.268Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:32.914Z InvocationID=ade4277a-8b9b-4589-96dc-77aae451296c ResponseDesc=OK 2021-07-13T00:46:35.673Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7fb2579e-c4e1-49f5-bba9-b24d46691691 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:35.673Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:35.673Z InvocationID=ba244d66-4cc3-4fab-9cad-9571256296c8 2021-07-13T00:46:35.857Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7fb2579e-c4e1-49f5-bba9-b24d46691691 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:36.061Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7fb2579e-c4e1-49f5-bba9-b24d46691691 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=388 EndTimestamp=2021-07-13T00:46:36.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:35.673Z InvocationID=f92eca6c-19d7-4e54-93c3-9cb72f57dd76 ResponseDesc=OK 2021-07-13T00:46:37.440Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=70a9361b-c831-4742-a6ed-49bb4cfe64c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:37.440Z InvocationID=95092710-cc30-4402-b348-ec60f1c588d1 2021-07-13T00:46:37.559Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=70a9361b-c831-4742-a6ed-49bb4cfe64c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:37.822Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=70a9361b-c831-4742-a6ed-49bb4cfe64c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=381 EndTimestamp=2021-07-13T00:46:37.821Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:37.440Z InvocationID=6c80c3e5-fd71-4ad4-98ce-1b1b65f39186 ResponseDesc=OK 2021-07-13T00:46:38.873Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9f230ef0-809a-491c-8536-baec2910f296 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:38.873Z InvocationID=be642f63-0749-4c88-ae84-b01e7ff0069b 2021-07-13T00:46:39.062Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9f230ef0-809a-491c-8536-baec2910f296 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:39.066Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a052b741-ca25-4b95-b243-b578f83ac693 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:39.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:39.066Z InvocationID=b8ecbc1d-0758-425f-8b18-ecf0085c6196 2021-07-13T00:46:39.256Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a052b741-ca25-4b95-b243-b578f83ac693 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:39.260Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9f230ef0-809a-491c-8536-baec2910f296 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=387 EndTimestamp=2021-07-13T00:46:39.260Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:38.873Z InvocationID=8042660b-f75b-45f2-9570-e21cf9d06376 ResponseDesc=OK 2021-07-13T00:46:39.568Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a052b741-ca25-4b95-b243-b578f83ac693 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=502 EndTimestamp=2021-07-13T00:46:39.568Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:39.066Z InvocationID=aa8581b8-d996-48f9-9c56-cc573e5a16e7 ResponseDesc=OK 2021-07-13T00:46:41.666Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=846610e1-2598-4075-82f2-3df5d39a4226 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:41.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:41.665Z InvocationID=23057b31-23c6-4ff1-aaca-1e3bce344338 2021-07-13T00:46:41.859Z [qtp817348612-56] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=846610e1-2598-4075-82f2-3df5d39a4226 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:42.276Z [qtp817348612-56] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=846610e1-2598-4075-82f2-3df5d39a4226 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=610 EndTimestamp=2021-07-13T00:46:42.275Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:41.665Z InvocationID=6926151b-b0ab-46ae-b93b-b488a840dc3f ResponseDesc=OK 2021-07-13T00:46:44.882Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=77b80696-923c-4564-85d4-1f6a16a1c148 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:44.881Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:44.881Z InvocationID=140118ea-64b2-4b9d-9bed-f1275c9f1c13 2021-07-13T00:46:46.312Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=77b80696-923c-4564-85d4-1f6a16a1c148 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:47.441Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=25850242-7be1-40ca-a1db-735340f4886b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:47.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:47.441Z InvocationID=8c5ecd69-6b64-4fef-bf28-029f06bcb728 2021-07-13T00:46:48.874Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6f0e1e74-2179-49f5-8963-1c8ebdbab3a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:48.873Z InvocationID=67c31ddd-c2c4-411a-a5a3-53ecd569a247 2021-07-13T00:46:49.157Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=25850242-7be1-40ca-a1db-735340f4886b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:49.666Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=77b80696-923c-4564-85d4-1f6a16a1c148 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4785 EndTimestamp=2021-07-13T00:46:49.666Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:44.881Z InvocationID=b86a1fc3-0a1e-4f30-8026-0ee457ee6223 ResponseDesc=OK 2021-07-13T00:46:49.721Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6f0e1e74-2179-49f5-8963-1c8ebdbab3a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:49.776Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31c235dc-257e-4906-8afc-fdf2cb515810 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:49.776Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:49.776Z InvocationID=e1051b68-f298-4dbd-a188-51ea7972126f 2021-07-13T00:46:49.857Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=25850242-7be1-40ca-a1db-735340f4886b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2416 EndTimestamp=2021-07-13T00:46:49.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:47.441Z InvocationID=41ff3964-1f54-4b01-8b48-ad97315c4f09 ResponseDesc=OK 2021-07-13T00:46:50.015Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31c235dc-257e-4906-8afc-fdf2cb515810 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:50.115Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6f0e1e74-2179-49f5-8963-1c8ebdbab3a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1242 EndTimestamp=2021-07-13T00:46:50.115Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:48.873Z InvocationID=d0b42d0e-3f86-4a9c-90ca-9daa0245e9ed ResponseDesc=OK 2021-07-13T00:46:50.263Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31c235dc-257e-4906-8afc-fdf2cb515810 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=487 EndTimestamp=2021-07-13T00:46:50.263Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:49.776Z InvocationID=565daf39-9290-4feb-8bd8-e925b9a2bd7d ResponseDesc=OK 2021-07-13T00:46:51.378Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e7568ab-1891-4deb-9682-c17aa61fe579 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:51.378Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:51.378Z InvocationID=36965e0a-9323-49aa-8c06-ccc745ce72c9 2021-07-13T00:46:51.756Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e7568ab-1891-4deb-9682-c17aa61fe579 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:52.358Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e7568ab-1891-4deb-9682-c17aa61fe579 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=980 EndTimestamp=2021-07-13T00:46:52.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:51.378Z InvocationID=65c7a349-38f9-446c-9790-9bf927ea2b90 ResponseDesc=OK 2021-07-13T00:46:54.622Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d389725f-bda8-4eb1-9119-8b6c708d0bc2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:54.621Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:54.621Z InvocationID=cf880d4a-fcfb-465f-af32-b27f8aa48ecd 2021-07-13T00:46:54.762Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d389725f-bda8-4eb1-9119-8b6c708d0bc2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:55.031Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d389725f-bda8-4eb1-9119-8b6c708d0bc2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=410 EndTimestamp=2021-07-13T00:46:55.031Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:54.621Z InvocationID=7da292c1-20c1-4d5e-8a85-ec1f11b3524f ResponseDesc=OK 2021-07-13T00:46:56.818Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=12febf71-b6cb-4593-a155-71692637affb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:56.818Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:56.818Z InvocationID=c3466662-1e85-44cf-8a21-de89921b920b 2021-07-13T00:46:57.165Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=12febf71-b6cb-4593-a155-71692637affb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:57.359Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=12febf71-b6cb-4593-a155-71692637affb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=541 EndTimestamp=2021-07-13T00:46:57.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:56.818Z InvocationID=73991ddf-139a-475c-8a2f-e8edf41d0b01 ResponseDesc=OK 2021-07-13T00:46:57.440Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=09f7f634-4911-48d8-a211-ba83d11c409f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:57.439Z InvocationID=6c987fc2-dd1f-4000-825e-3ff7c7afd5be 2021-07-13T00:46:57.556Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=09f7f634-4911-48d8-a211-ba83d11c409f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:57.966Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=09f7f634-4911-48d8-a211-ba83d11c409f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=527 EndTimestamp=2021-07-13T00:46:57.966Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:57.439Z InvocationID=7125b8a9-757f-4a08-8184-d98fe5766386 ResponseDesc=OK 2021-07-13T00:46:58.873Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=36b27f3e-9106-4f1b-a19d-b80a2478ca89 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:46:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:58.873Z InvocationID=4dc72416-956c-4a23-bfd4-eba05edac6d9 2021-07-13T00:46:59.058Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=36b27f3e-9106-4f1b-a19d-b80a2478ca89 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:46:59.325Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=36b27f3e-9106-4f1b-a19d-b80a2478ca89 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=452 EndTimestamp=2021-07-13T00:46:59.325Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:46:58.873Z InvocationID=74a57d38-6e53-40e4-a5c0-d97f2fe45a73 ResponseDesc=OK 2021-07-13T00:47:00.065Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d59c66d7-2972-4d4d-8d66-5e99eada591b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:00.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:00.065Z InvocationID=63472552-8313-42d0-8360-382348029b3a 2021-07-13T00:47:00.310Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d59c66d7-2972-4d4d-8d66-5e99eada591b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:00.459Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d59c66d7-2972-4d4d-8d66-5e99eada591b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=394 EndTimestamp=2021-07-13T00:47:00.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:00.065Z InvocationID=5132d79e-b1f2-4ea8-82a9-5790eab2f421 ResponseDesc=OK 2021-07-13T00:47:03.065Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ee2a6137-5e18-4cac-9ae5-673dbad73ad9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:03.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:03.064Z InvocationID=c8263cb6-3ded-4115-a2f5-005498fa13d3 2021-07-13T00:47:03.159Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ee2a6137-5e18-4cac-9ae5-673dbad73ad9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:03.457Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ee2a6137-5e18-4cac-9ae5-673dbad73ad9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=393 EndTimestamp=2021-07-13T00:47:03.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:03.064Z InvocationID=94888219-7004-47c4-806a-7f0e538f1145 ResponseDesc=OK 2021-07-13T00:47:06.328Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6a1ac971-1a79-4f76-90de-41744c8cf5ba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:06.328Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:06.328Z InvocationID=e9f41e93-1197-4a99-b526-084e2dd67c10 2021-07-13T00:47:06.459Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6a1ac971-1a79-4f76-90de-41744c8cf5ba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:07.139Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6a1ac971-1a79-4f76-90de-41744c8cf5ba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=811 EndTimestamp=2021-07-13T00:47:07.139Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:06.328Z InvocationID=4b6e1c21-0f78-431b-a65a-ec5dd9e1ac35 ResponseDesc=OK 2021-07-13T00:47:07.440Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=828404c3-8859-4288-9cca-8889e534791f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:07.440Z InvocationID=a1404e78-e23f-4359-bc8c-a9e98a57eb29 2021-07-13T00:47:07.970Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=828404c3-8859-4288-9cca-8889e534791f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:08.159Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=828404c3-8859-4288-9cca-8889e534791f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=719 EndTimestamp=2021-07-13T00:47:08.159Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:07.440Z InvocationID=f2c98d07-381b-4e64-adfb-150a6fec9639 ResponseDesc=OK 2021-07-13T00:47:08.772Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8295e74a-0375-4049-80f2-a6946f145008 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:08.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:08.772Z InvocationID=9e6526cf-6ba0-42c6-b848-452452ead7cb 2021-07-13T00:47:08.874Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8d5a106e-34f4-42ff-bb00-7e5f490279f7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:08.874Z InvocationID=0a3757df-f9bd-4ac5-957d-5dd413bf3413 2021-07-13T00:47:10.257Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8295e74a-0375-4049-80f2-a6946f145008 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:10.317Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8d5a106e-34f4-42ff-bb00-7e5f490279f7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:10.858Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8295e74a-0375-4049-80f2-a6946f145008 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2086 EndTimestamp=2021-07-13T00:47:10.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:08.772Z InvocationID=6afece54-93c7-4fdd-a740-529e1ba05f0c ResponseDesc=OK 2021-07-13T00:47:11.225Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8d5a106e-34f4-42ff-bb00-7e5f490279f7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2350 EndTimestamp=2021-07-13T00:47:11.224Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:08.874Z InvocationID=40ae2ded-1b57-4463-b172-30e3a6b465ce ResponseDesc=OK 2021-07-13T00:47:12.164Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9ebecb91-a36b-45b9-9457-a55e3dff8a4e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:12.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:12.163Z InvocationID=6c841799-bf42-4c71-843e-243e48ac5174 2021-07-13T00:47:12.411Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9ebecb91-a36b-45b9-9457-a55e3dff8a4e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:12.760Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9ebecb91-a36b-45b9-9457-a55e3dff8a4e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=596 EndTimestamp=2021-07-13T00:47:12.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:12.163Z InvocationID=bc36ac4f-3c81-47aa-8a63-baaa63a3f182 ResponseDesc=OK 2021-07-13T00:47:15.064Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=745fee7c-87ec-47a1-9d88-df4cd464048d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:15.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:15.064Z InvocationID=676f4fbd-7184-4545-8601-e9d2914f0cf1 2021-07-13T00:47:15.257Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=745fee7c-87ec-47a1-9d88-df4cd464048d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:15.557Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=745fee7c-87ec-47a1-9d88-df4cd464048d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=493 EndTimestamp=2021-07-13T00:47:15.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:15.064Z InvocationID=206f1b17-5cfd-4723-af48-d9188557f2e8 ResponseDesc=OK 2021-07-13T00:47:17.442Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f7e0f0f1-1ecd-4a30-8c5a-3418545f9e3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:17.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:17.441Z InvocationID=360ee5cf-d259-4e0e-a5fa-18be6b47b177 2021-07-13T00:47:17.563Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f7e0f0f1-1ecd-4a30-8c5a-3418545f9e3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:18.163Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4493eb5f-cf5e-4b14-8995-0c73539eb9f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:18.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:18.162Z InvocationID=7bf5a0cd-f9a2-4d3a-acd2-54aabf8e9ca0 2021-07-13T00:47:18.877Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ed7fd5e4-c20a-4e2a-80ee-54c4c67c211e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:18.877Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:18.877Z InvocationID=51c2574d-1d4c-4f6b-b323-2936ad26e880 2021-07-13T00:47:23.612Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ed7fd5e4-c20a-4e2a-80ee-54c4c67c211e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:23.713Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f7e0f0f1-1ecd-4a30-8c5a-3418545f9e3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=6272 EndTimestamp=2021-07-13T00:47:23.713Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:17.441Z InvocationID=4f2248c3-a00d-45eb-8919-db133a6b21a2 ResponseDesc=OK 2021-07-13T00:47:23.713Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4493eb5f-cf5e-4b14-8995-0c73539eb9f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:23.862Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ed7fd5e4-c20a-4e2a-80ee-54c4c67c211e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4984 EndTimestamp=2021-07-13T00:47:23.861Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:18.877Z InvocationID=5204e68b-9b6b-41de-bc2a-54b8e4ae7c71 ResponseDesc=OK 2021-07-13T00:47:24.157Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4493eb5f-cf5e-4b14-8995-0c73539eb9f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5995 EndTimestamp=2021-07-13T00:47:24.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:18.162Z InvocationID=5a73984d-6347-4390-97d1-5e3d8ae18bce ResponseDesc=OK 2021-07-13T00:47:24.869Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=778bd275-713c-4dd9-81a3-ee225b03943d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:24.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:24.869Z InvocationID=ebdd1106-981e-4930-ac8f-30e11b6a1dcf 2021-07-13T00:47:25.159Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=778bd275-713c-4dd9-81a3-ee225b03943d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:25.516Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=778bd275-713c-4dd9-81a3-ee225b03943d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=647 EndTimestamp=2021-07-13T00:47:25.516Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:24.869Z InvocationID=e76b6028-a7dd-4441-b636-416240fb3554 ResponseDesc=OK 2021-07-13T00:47:26.268Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e39c82ad-d69a-4928-99e9-b66ec83c51fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:26.268Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:26.268Z InvocationID=3564c622-7b00-4249-a01e-e8552ca973f9 2021-07-13T00:47:26.458Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e39c82ad-d69a-4928-99e9-b66ec83c51fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:27.060Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e39c82ad-d69a-4928-99e9-b66ec83c51fa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=792 EndTimestamp=2021-07-13T00:47:27.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:26.268Z InvocationID=a91fa99b-0610-4f59-bc11-88946c7feff8 ResponseDesc=OK 2021-07-13T00:47:27.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=86e372c2-e467-40c9-a956-a5e66b4c814b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:27.439Z InvocationID=00ca9b74-57fe-4922-9248-46d678c7b8f2 2021-07-13T00:47:27.557Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=86e372c2-e467-40c9-a956-a5e66b4c814b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:28.072Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d59506a8-e89d-4809-8a14-49ddd0521901 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:28.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:28.072Z InvocationID=da002d1b-b44b-43df-8828-88932cae3698 2021-07-13T00:47:28.559Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d59506a8-e89d-4809-8a14-49ddd0521901 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:28.721Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=86e372c2-e467-40c9-a956-a5e66b4c814b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1282 EndTimestamp=2021-07-13T00:47:28.721Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:27.439Z InvocationID=a42e7d8e-4194-4735-852f-cca1db3b5583 ResponseDesc=OK 2021-07-13T00:47:28.812Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d59506a8-e89d-4809-8a14-49ddd0521901 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=740 EndTimestamp=2021-07-13T00:47:28.812Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:28.072Z InvocationID=91ed92d3-30be-44b6-9ffe-a05b588b9033 ResponseDesc=OK 2021-07-13T00:47:28.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a4d37ad8-ed16-4798-8d57-eb738d3751fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:28.873Z InvocationID=31d2fc5e-ce62-4c1c-ae73-95248b47b3d8 2021-07-13T00:47:29.117Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a4d37ad8-ed16-4798-8d57-eb738d3751fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:29.359Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a4d37ad8-ed16-4798-8d57-eb738d3751fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:47:29.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:28.873Z InvocationID=5c2f5ee0-123f-47b1-a9ce-3108daa058b7 ResponseDesc=OK 2021-07-13T00:47:29.852Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=244dbfac-0ceb-4c7f-9ac7-45096b203744 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:29.852Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:29.852Z InvocationID=6c793bc3-6610-40b3-82d8-f686567271e5 2021-07-13T00:47:29.957Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=244dbfac-0ceb-4c7f-9ac7-45096b203744 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:31.457Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=244dbfac-0ceb-4c7f-9ac7-45096b203744 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1605 EndTimestamp=2021-07-13T00:47:31.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:29.852Z InvocationID=90869b1b-04c0-4cd7-80f4-20ebff2f4fcc ResponseDesc=OK 2021-07-13T00:47:33.064Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e0ff518d-04b6-4493-964e-a9c7bcd11860 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:33.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:33.064Z InvocationID=40b519ac-1f59-413a-8a43-340fd17f1e91 2021-07-13T00:47:33.160Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e0ff518d-04b6-4493-964e-a9c7bcd11860 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:33.619Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e0ff518d-04b6-4493-964e-a9c7bcd11860 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=555 EndTimestamp=2021-07-13T00:47:33.619Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:33.064Z InvocationID=e429f438-cb53-4d82-ba7f-fc143c056e84 ResponseDesc=OK 2021-07-13T00:47:35.767Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1a9b4afa-5ec1-420c-8129-1416ac011367 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:35.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:35.767Z InvocationID=946df841-b6ba-4807-ad07-a37cab9868be 2021-07-13T00:47:36.857Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1a9b4afa-5ec1-420c-8129-1416ac011367 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:37.059Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1a9b4afa-5ec1-420c-8129-1416ac011367 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1292 EndTimestamp=2021-07-13T00:47:37.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:35.767Z InvocationID=abd3c5ac-a7dc-4896-be25-a5afd7d71dec ResponseDesc=OK 2021-07-13T00:47:37.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=389b7a4e-6eec-4f61-853a-4123e731d5e7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:37.439Z InvocationID=2295b710-da6a-41d6-b1ad-3a2c3dfa6fdf 2021-07-13T00:47:37.558Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=389b7a4e-6eec-4f61-853a-4123e731d5e7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:38.258Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=389b7a4e-6eec-4f61-853a-4123e731d5e7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=819 EndTimestamp=2021-07-13T00:47:38.258Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:37.439Z InvocationID=8333f57e-a319-4bd8-b0e7-718fe45383d7 ResponseDesc=OK 2021-07-13T00:47:38.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f582e6f-b703-418e-a96c-7cc8ab4777e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:38.873Z InvocationID=cd3f2db4-c40b-4a3a-b9c4-90649962d225 2021-07-13T00:47:38.963Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f582e6f-b703-418e-a96c-7cc8ab4777e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:39.060Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c2d84595-1bb8-411b-8eef-12e51a93db8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:39.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:39.059Z InvocationID=57669227-b674-4e47-b36b-e42fb45368db 2021-07-13T00:47:39.338Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c2d84595-1bb8-411b-8eef-12e51a93db8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:39.559Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c2d84595-1bb8-411b-8eef-12e51a93db8a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=500 EndTimestamp=2021-07-13T00:47:39.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:39.059Z InvocationID=fb6e4f24-7d51-4ccf-8fa1-ddaa2578a32f ResponseDesc=OK 2021-07-13T00:47:39.814Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0f582e6f-b703-418e-a96c-7cc8ab4777e5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=941 EndTimestamp=2021-07-13T00:47:39.814Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:38.873Z InvocationID=1e07953b-9d70-4d45-b654-a51240b2af75 ResponseDesc=OK 2021-07-13T00:47:41.767Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0c0eab3b-cca8-4db2-a071-d729a28154d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:41.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:41.767Z InvocationID=b36acf15-8e49-4190-b0fb-4c987373a086 2021-07-13T00:47:41.956Z [qtp817348612-48] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0c0eab3b-cca8-4db2-a071-d729a28154d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:42.357Z [qtp817348612-48] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0c0eab3b-cca8-4db2-a071-d729a28154d7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=590 EndTimestamp=2021-07-13T00:47:42.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:41.767Z InvocationID=f08f5f3f-80b1-40ba-8f73-d8d9e23d2cbe ResponseDesc=OK 2021-07-13T00:47:44.963Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dc4540a6-b7aa-4814-9c3a-303b4e388e0d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:44.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:44.963Z InvocationID=c4064235-0926-40db-8355-22c3cdf55f5f 2021-07-13T00:47:45.061Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dc4540a6-b7aa-4814-9c3a-303b4e388e0d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:45.512Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dc4540a6-b7aa-4814-9c3a-303b4e388e0d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=549 EndTimestamp=2021-07-13T00:47:45.512Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:44.963Z InvocationID=c24e209b-3130-4ba6-b733-b73565245b63 ResponseDesc=OK 2021-07-13T00:47:47.441Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2e951a9b-d41b-4fca-8db0-73466ba18e02 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:47.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:47.441Z InvocationID=38236614-da7a-41ec-9438-5dd7059068cb 2021-07-13T00:47:47.869Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=900a46b0-6b52-4350-8780-02390245c47c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:47.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:47.869Z InvocationID=cfda6579-e14f-4a2e-afdd-75ebd7287ef0 2021-07-13T00:47:48.261Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=900a46b0-6b52-4350-8780-02390245c47c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:48.314Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2e951a9b-d41b-4fca-8db0-73466ba18e02 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:48.460Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=900a46b0-6b52-4350-8780-02390245c47c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=591 EndTimestamp=2021-07-13T00:47:48.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:47.869Z InvocationID=11ca7ecf-479b-436f-b7b6-d5bea2b4e11d ResponseDesc=OK 2021-07-13T00:47:48.760Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2e951a9b-d41b-4fca-8db0-73466ba18e02 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1319 EndTimestamp=2021-07-13T00:47:48.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:47.441Z InvocationID=e2e823f6-6d10-4bc7-8c67-7201329172fb ResponseDesc=OK 2021-07-13T00:47:48.874Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a923cb78-0df4-4b91-984e-1f0bdab12576 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:48.873Z InvocationID=a926dfc7-cc0f-41b0-b00a-38ab54bc9b3e 2021-07-13T00:47:50.559Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a923cb78-0df4-4b91-984e-1f0bdab12576 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:51.115Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a923cb78-0df4-4b91-984e-1f0bdab12576 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2242 EndTimestamp=2021-07-13T00:47:51.115Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:48.873Z InvocationID=97f4f2f2-5966-45e4-a437-15bd14e1ea37 ResponseDesc=OK 2021-07-13T00:47:51.320Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0fa9a925-ce66-4920-aa8c-1684609c0943 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:51.320Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:51.320Z InvocationID=bfc44e2f-9b92-4a59-8b12-47d9a5e96be3 2021-07-13T00:47:51.730Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0fa9a925-ce66-4920-aa8c-1684609c0943 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:51.960Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0fa9a925-ce66-4920-aa8c-1684609c0943 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=639 EndTimestamp=2021-07-13T00:47:51.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:51.320Z InvocationID=f12e0475-2d80-47c5-a775-de4727c8acc9 ResponseDesc=OK 2021-07-13T00:47:53.764Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c056eeeb-5020-4c14-b6a4-dabb1083441a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:53.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:53.764Z InvocationID=eda16ac8-db36-49b2-b970-169e0d0040cd 2021-07-13T00:47:53.957Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c056eeeb-5020-4c14-b6a4-dabb1083441a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:54.357Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c056eeeb-5020-4c14-b6a4-dabb1083441a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=593 EndTimestamp=2021-07-13T00:47:54.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:53.764Z InvocationID=9f140043-ae4a-4580-90d1-9d74b580d7d6 ResponseDesc=OK 2021-07-13T00:47:56.869Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=55b9121d-57e3-4bd5-b122-f75d10775bc0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:56.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:56.869Z InvocationID=3e32ca58-107a-4d29-bafb-351ebf40d251 2021-07-13T00:47:57.059Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=55b9121d-57e3-4bd5-b122-f75d10775bc0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:57.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4a7b7ea3-913f-4d83-8af1-112113c6d282 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:57.440Z InvocationID=0f7c916c-2f7c-4268-9717-e489817dacf9 2021-07-13T00:47:57.516Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=55b9121d-57e3-4bd5-b122-f75d10775bc0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=647 EndTimestamp=2021-07-13T00:47:57.516Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:56.869Z InvocationID=7af4fa90-faa5-47b1-8e8d-187748524c4b ResponseDesc=OK 2021-07-13T00:47:57.729Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4a7b7ea3-913f-4d83-8af1-112113c6d282 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:47:57.964Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4a7b7ea3-913f-4d83-8af1-112113c6d282 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=524 EndTimestamp=2021-07-13T00:47:57.964Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:57.440Z InvocationID=8d665c38-55f9-447c-987b-9d029c5cd3b3 ResponseDesc=OK 2021-07-13T00:47:58.874Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a1060cb3-fe32-4d79-813c-5148e5938954 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:47:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:58.874Z InvocationID=82f614fc-9ae6-4b43-9930-583a985a1129 2021-07-13T00:47:59.156Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a1060cb3-fe32-4d79-813c-5148e5938954 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:00.129Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=33a4f765-666e-4809-8676-43a4bde328c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:00.129Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:00.129Z InvocationID=2e3311d9-fedf-4510-8749-faa7fa91113e 2021-07-13T00:48:00.157Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a1060cb3-fe32-4d79-813c-5148e5938954 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1282 EndTimestamp=2021-07-13T00:48:00.156Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:47:58.874Z InvocationID=f8b4f0d1-a669-43ea-a363-7d2f514cd153 ResponseDesc=OK 2021-07-13T00:48:00.259Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=33a4f765-666e-4809-8676-43a4bde328c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:00.563Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=33a4f765-666e-4809-8676-43a4bde328c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=434 EndTimestamp=2021-07-13T00:48:00.563Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:00.129Z InvocationID=01034383-f6f4-49a8-ac4f-939712ac8248 ResponseDesc=OK 2021-07-13T00:48:02.766Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c442363a-0dd2-49aa-bfbc-693f5f32b167 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:02.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:02.766Z InvocationID=e664e6af-2cd7-4f9d-aeaa-0c360144e5e2 2021-07-13T00:48:06.915Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4509d795-15cb-49c4-aa4f-0c2ea3f05b83 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:06.915Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:06.915Z InvocationID=51b85b29-226e-4158-abe0-d86b4f3a0481 2021-07-13T00:48:07.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6979a0c3-8445-4a61-a038-2a65498d11fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:07.439Z InvocationID=3cc8d8cd-ab36-4482-b6d0-dba28452ca22 2021-07-13T00:48:07.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6979a0c3-8445-4a61-a038-2a65498d11fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:07.560Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4509d795-15cb-49c4-aa4f-0c2ea3f05b83 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:07.613Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c442363a-0dd2-49aa-bfbc-693f5f32b167 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:07.761Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4509d795-15cb-49c4-aa4f-0c2ea3f05b83 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=846 EndTimestamp=2021-07-13T00:48:07.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:06.915Z InvocationID=6ee981c7-6b16-454a-ac34-9f298b9f6bc6 ResponseDesc=OK 2021-07-13T00:48:08.058Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c442363a-0dd2-49aa-bfbc-693f5f32b167 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5292 EndTimestamp=2021-07-13T00:48:08.058Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:02.766Z InvocationID=44891e48-6e1a-4c84-b9f2-3cbebfd46d53 ResponseDesc=OK 2021-07-13T00:48:08.211Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6979a0c3-8445-4a61-a038-2a65498d11fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=772 EndTimestamp=2021-07-13T00:48:08.211Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:07.439Z InvocationID=0dd02d16-04c2-4dbc-94bd-8e17d026554d ResponseDesc=OK 2021-07-13T00:48:08.874Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cf1cbbe8-b19a-4c1a-a287-38bcdee368aa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:08.873Z InvocationID=1247bb69-8120-4dd8-8baa-b69984437583 2021-07-13T00:48:09.071Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=add86434-4e2a-4946-8830-e3b85913ee78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:09.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:09.071Z InvocationID=2fbcdc2a-fb2c-4193-9a06-bfb5c14114dc 2021-07-13T00:48:09.117Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cf1cbbe8-b19a-4c1a-a287-38bcdee368aa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:09.163Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=add86434-4e2a-4946-8830-e3b85913ee78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:09.360Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cf1cbbe8-b19a-4c1a-a287-38bcdee368aa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=487 EndTimestamp=2021-07-13T00:48:09.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:08.873Z InvocationID=a5aed227-ce9b-45a3-bc03-3c8ca244759f ResponseDesc=OK 2021-07-13T00:48:09.557Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=add86434-4e2a-4946-8830-e3b85913ee78 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:48:09.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:09.071Z InvocationID=3bcf1bbd-052b-4e8c-933c-06e1c7d6ebd3 ResponseDesc=OK 2021-07-13T00:48:11.764Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ded831fb-c1c0-4475-a765-5d948380043b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:11.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:11.764Z InvocationID=8e37ab3f-54f8-43cf-95f5-527a4f35aa72 2021-07-13T00:48:11.962Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ded831fb-c1c0-4475-a765-5d948380043b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:12.315Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ded831fb-c1c0-4475-a765-5d948380043b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=550 EndTimestamp=2021-07-13T00:48:12.314Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:11.764Z InvocationID=6ee3fd86-6b67-41af-b9eb-56658138c00c ResponseDesc=OK 2021-07-13T00:48:14.779Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e2afff03-ddc3-44ce-aea0-2bae83de4fc4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:14.779Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:14.779Z InvocationID=5e69ebc9-758b-46bd-958b-f7d4f0623b42 2021-07-13T00:48:14.972Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e2afff03-ddc3-44ce-aea0-2bae83de4fc4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:15.165Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e2afff03-ddc3-44ce-aea0-2bae83de4fc4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=386 EndTimestamp=2021-07-13T00:48:15.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:14.779Z InvocationID=7636daa6-8aa2-4558-8b71-f8b42f0be663 ResponseDesc=OK 2021-07-13T00:48:17.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d1d6c696-ceb5-4d1d-b115-86a7353ef1f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:17.439Z InvocationID=83528d04-51a0-471e-9a9d-3508b63e7535 2021-07-13T00:48:17.563Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d1d6c696-ceb5-4d1d-b115-86a7353ef1f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:18.874Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=544a7e66-4eba-4da6-8339-1c1241b58864 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:18.873Z InvocationID=c96c681b-562c-4317-996f-e32664d763ca 2021-07-13T00:48:25.857Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d1d6c696-ceb5-4d1d-b115-86a7353ef1f8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=8418 EndTimestamp=2021-07-13T00:48:25.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:17.439Z InvocationID=a46ffccc-b37f-48b7-960e-6fe581f4f545 ResponseDesc=OK 2021-07-13T00:48:26.163Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=544a7e66-4eba-4da6-8339-1c1241b58864 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:26.836Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=544a7e66-4eba-4da6-8339-1c1241b58864 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=7963 EndTimestamp=2021-07-13T00:48:26.836Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:18.873Z InvocationID=afbd8222-16ca-4ba4-ab90-0734e7aa8cc3 ResponseDesc=OK 2021-07-13T00:48:27.439Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e8a1b61c-31b9-42ad-885a-b539d7846a6a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:27.439Z InvocationID=8797093f-15fc-49ea-aacc-a6ab13b024e1 2021-07-13T00:48:27.522Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0436c147-3b37-4d8f-9440-a16030683261 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:27.522Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:27.522Z InvocationID=bc1a138d-1dff-49c4-bf4b-c02a20ab9e5f 2021-07-13T00:48:27.663Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0436c147-3b37-4d8f-9440-a16030683261 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:28.078Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0436c147-3b37-4d8f-9440-a16030683261 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=556 EndTimestamp=2021-07-13T00:48:28.078Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:27.522Z InvocationID=81c390a9-76aa-476d-9ad1-ea41305d418a ResponseDesc=OK 2021-07-13T00:48:28.133Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e8a1b61c-31b9-42ad-885a-b539d7846a6a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:28.457Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e8a1b61c-31b9-42ad-885a-b539d7846a6a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1018 EndTimestamp=2021-07-13T00:48:28.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:27.439Z InvocationID=19cf9e43-cb73-4b98-af58-fa85a529c5b4 ResponseDesc=OK 2021-07-13T00:48:28.873Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7093d766-5736-4c71-994e-dc37fa1c0514 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:28.873Z InvocationID=87f45cab-d82d-4be0-b0ff-32f55ee16d1b 2021-07-13T00:48:29.059Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7093d766-5736-4c71-994e-dc37fa1c0514 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:29.071Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=765dbef3-ec7f-44c8-820a-3d7c8b402c0a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:29.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:29.071Z InvocationID=ae753465-41ca-41d4-9918-e014ff0f2c72 2021-07-13T00:48:29.323Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=765dbef3-ec7f-44c8-820a-3d7c8b402c0a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:29.959Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=765dbef3-ec7f-44c8-820a-3d7c8b402c0a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=888 EndTimestamp=2021-07-13T00:48:29.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:29.071Z InvocationID=bffa67bf-f5a5-4afa-af65-b759a6b37598 ResponseDesc=OK 2021-07-13T00:48:33.167Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7093d766-5736-4c71-994e-dc37fa1c0514 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4294 EndTimestamp=2021-07-13T00:48:33.167Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:28.873Z InvocationID=e35ff124-54ed-44be-8805-d51f6c5ed899 ResponseDesc=OK 2021-07-13T00:48:33.376Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e0e1f3f9-cb50-44f9-b738-b89b91d4fed5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:33.376Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:33.376Z InvocationID=001d7fa9-ee03-4fb3-b994-39bf2783fde6 2021-07-13T00:48:35.391Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e0e1f3f9-cb50-44f9-b738-b89b91d4fed5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:36.168Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e0e1f3f9-cb50-44f9-b738-b89b91d4fed5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2792 EndTimestamp=2021-07-13T00:48:36.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:33.376Z InvocationID=7efbf706-4667-411d-9c6f-560baba81c62 ResponseDesc=OK 2021-07-13T00:48:37.438Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f2f863b9-2b1c-4ea3-9318-afa4f7bba61e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:37.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:37.438Z InvocationID=8fb4b48d-c19b-431a-a9ed-fc5ea028e02a 2021-07-13T00:48:37.471Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4ccece91-1262-408a-b490-8c88799de559 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:37.471Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:37.471Z InvocationID=be6de796-c48e-456a-9db1-8ebfdc681816 2021-07-13T00:48:37.658Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f2f863b9-2b1c-4ea3-9318-afa4f7bba61e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:37.664Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4ccece91-1262-408a-b490-8c88799de559 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:38.060Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f2f863b9-2b1c-4ea3-9318-afa4f7bba61e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=622 EndTimestamp=2021-07-13T00:48:38.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:37.438Z InvocationID=3ce392e5-309d-4241-afd9-020653d796ed ResponseDesc=OK 2021-07-13T00:48:38.117Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4ccece91-1262-408a-b490-8c88799de559 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=646 EndTimestamp=2021-07-13T00:48:38.117Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:37.471Z InvocationID=3b46f309-ab76-49bf-ab99-e7b87dd8cfc0 ResponseDesc=OK 2021-07-13T00:48:38.874Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=725e5587-4f2c-4733-ac65-3c45d2af62ae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:38.874Z InvocationID=c48e2041-3914-477c-8b8a-bc689dd177ba 2021-07-13T00:48:38.967Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=725e5587-4f2c-4733-ac65-3c45d2af62ae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:39.257Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=725e5587-4f2c-4733-ac65-3c45d2af62ae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=383 EndTimestamp=2021-07-13T00:48:39.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:38.874Z InvocationID=e4819328-e45e-4cc0-b1a2-0151b489cec7 ResponseDesc=OK 2021-07-13T00:48:39.421Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5062d4a7-3552-4fb1-bfe7-5e2c1debb925 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:39.421Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:39.421Z InvocationID=740b1add-fc50-406a-911f-759bdca3f402 2021-07-13T00:48:39.568Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5062d4a7-3552-4fb1-bfe7-5e2c1debb925 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:39.879Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5062d4a7-3552-4fb1-bfe7-5e2c1debb925 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=458 EndTimestamp=2021-07-13T00:48:39.879Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:39.421Z InvocationID=e67701d0-6223-45c9-918c-55f13e16bccb ResponseDesc=OK 2021-07-13T00:48:40.963Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=40295c5f-869b-4b54-8954-843d69c9a694 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:40.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:40.963Z InvocationID=06dd26a0-2232-4eab-82fe-f988f781c67f 2021-07-13T00:48:41.211Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=40295c5f-869b-4b54-8954-843d69c9a694 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:41.472Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=40295c5f-869b-4b54-8954-843d69c9a694 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=509 EndTimestamp=2021-07-13T00:48:41.472Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:40.963Z InvocationID=b6566485-d4fa-4665-8c38-57191ef21776 ResponseDesc=OK 2021-07-13T00:48:42.461Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d2fd496b-ee07-4249-aa72-b70aed020f11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:42.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:42.461Z InvocationID=7e3d906c-6792-4b97-ab9a-04571c1f0f85 2021-07-13T00:48:42.557Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d2fd496b-ee07-4249-aa72-b70aed020f11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:42.857Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d2fd496b-ee07-4249-aa72-b70aed020f11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=396 EndTimestamp=2021-07-13T00:48:42.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:42.461Z InvocationID=0a483fb3-9409-425b-bdd7-031546de75ef ResponseDesc=OK 2021-07-13T00:48:43.965Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=71f0310c-aac5-4c8e-81f2-167dde91651a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:43.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:43.965Z InvocationID=c45f0031-cadb-4042-9dad-a39351eb4411 2021-07-13T00:48:44.059Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=71f0310c-aac5-4c8e-81f2-167dde91651a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:44.336Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=71f0310c-aac5-4c8e-81f2-167dde91651a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=371 EndTimestamp=2021-07-13T00:48:44.336Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:43.965Z InvocationID=399134f7-c89c-42ca-8a44-d8d313569e37 ResponseDesc=OK 2021-07-13T00:48:45.264Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=96da753e-2240-421e-9dbb-45d4e176de6f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:45.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:45.264Z InvocationID=3cd858a0-fe9f-4526-b183-c0c7c28e14dd 2021-07-13T00:48:45.364Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=96da753e-2240-421e-9dbb-45d4e176de6f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:45.574Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=96da753e-2240-421e-9dbb-45d4e176de6f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=310 EndTimestamp=2021-07-13T00:48:45.574Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:45.264Z InvocationID=d24188ae-7e16-486e-a0be-eb42f981a204 ResponseDesc=OK 2021-07-13T00:48:46.669Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e03c3164-0ffa-449c-9c7e-a7d571cf9ec4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:46.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:46.669Z InvocationID=14317197-9400-49a0-b0ac-e2499e0d3a61 2021-07-13T00:48:46.857Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e03c3164-0ffa-449c-9c7e-a7d571cf9ec4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:47.257Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e03c3164-0ffa-449c-9c7e-a7d571cf9ec4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=588 EndTimestamp=2021-07-13T00:48:47.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:46.669Z InvocationID=d5ee784c-2d73-45ab-8c7a-8dc84d8f2b3d ResponseDesc=OK 2021-07-13T00:48:47.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e0e3d4a1-151f-4ba3-9c27-98eed822ee81 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:47.439Z InvocationID=67911d37-16e5-415f-9f5c-b6b2bb58cb20 2021-07-13T00:48:47.559Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e0e3d4a1-151f-4ba3-9c27-98eed822ee81 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:48.223Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e0e3d4a1-151f-4ba3-9c27-98eed822ee81 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=784 EndTimestamp=2021-07-13T00:48:48.223Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:47.439Z InvocationID=d4354a5f-648d-4bf6-b868-7436ef29fb86 ResponseDesc=OK 2021-07-13T00:48:48.363Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b29e294b-840d-4ac9-8ac6-e6eb56e1f7f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:48.363Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:48.363Z InvocationID=16f373b6-e3de-4ab0-8765-2454ffbc9abe 2021-07-13T00:48:48.372Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b29e294b-840d-4ac9-8ac6-e6eb56e1f7f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:48.562Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b29e294b-840d-4ac9-8ac6-e6eb56e1f7f9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=199 EndTimestamp=2021-07-13T00:48:48.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:48.363Z InvocationID=596bedef-fef4-485c-8181-0ff432b0d438 ResponseDesc=OK 2021-07-13T00:48:48.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=96569408-9df1-461c-9f3f-5c4eb5d9f9d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:48.873Z InvocationID=0f70f499-8435-42b2-bfe6-d8d5b02f17ed 2021-07-13T00:48:48.968Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=96569408-9df1-461c-9f3f-5c4eb5d9f9d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:49.257Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=96569408-9df1-461c-9f3f-5c4eb5d9f9d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=384 EndTimestamp=2021-07-13T00:48:49.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:48.873Z InvocationID=1cfd8e65-c8b9-442c-b041-eaa59047efae ResponseDesc=OK 2021-07-13T00:48:50.967Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3788e0ff-e87b-4fc3-bca9-28c0db6f8e12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:50.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:50.967Z InvocationID=b8588a67-e1ce-4569-b31f-30ab39da1bf0 2021-07-13T00:48:51.062Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3788e0ff-e87b-4fc3-bca9-28c0db6f8e12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:51.412Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3788e0ff-e87b-4fc3-bca9-28c0db6f8e12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=445 EndTimestamp=2021-07-13T00:48:51.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:50.967Z InvocationID=28fce765-968a-4e0d-8e7d-6ba4e175853f ResponseDesc=OK 2021-07-13T00:48:53.862Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9c2502c2-f26a-4990-b8e4-644ab3512f52 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:53.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:53.862Z InvocationID=3826a7af-14a3-4b7e-871a-cd772cb57938 2021-07-13T00:48:54.115Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9c2502c2-f26a-4990-b8e4-644ab3512f52 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:54.360Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9c2502c2-f26a-4990-b8e4-644ab3512f52 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=498 EndTimestamp=2021-07-13T00:48:54.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:53.862Z InvocationID=f81db959-3bca-4ecc-9275-7cd399e04011 ResponseDesc=OK 2021-07-13T00:48:56.776Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=34bc2761-d007-4aa9-99ae-12b036ce2030 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:56.776Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:56.776Z InvocationID=a0998e06-5997-4c27-8ea9-b7a9d70826ee 2021-07-13T00:48:56.957Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=34bc2761-d007-4aa9-99ae-12b036ce2030 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:57.258Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=34bc2761-d007-4aa9-99ae-12b036ce2030 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=482 EndTimestamp=2021-07-13T00:48:57.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:56.776Z InvocationID=b94f83a9-f6d9-4a30-a359-703b142aa2d4 ResponseDesc=OK 2021-07-13T00:48:57.439Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=87b4cf0f-f1ae-4e06-8e73-62daf8b40088 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:57.439Z InvocationID=0c27ce30-410f-4267-8feb-7629c7038cb8 2021-07-13T00:48:57.665Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=87b4cf0f-f1ae-4e06-8e73-62daf8b40088 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:58.111Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=87b4cf0f-f1ae-4e06-8e73-62daf8b40088 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=671 EndTimestamp=2021-07-13T00:48:58.110Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:57.439Z InvocationID=d5276d60-16f2-40a7-873b-19f6bb4014a5 ResponseDesc=OK 2021-07-13T00:48:58.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0fa5fc66-1e21-400c-981e-4ca5effd2641 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:58.873Z InvocationID=8969930c-589a-4c88-852a-6645237ec6c0 2021-07-13T00:48:59.117Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0fa5fc66-1e21-400c-981e-4ca5effd2641 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:48:59.359Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0fa5fc66-1e21-400c-981e-4ca5effd2641 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:48:59.359Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:58.873Z InvocationID=1f0501fe-aef1-4ee0-9686-27f6c280404b ResponseDesc=OK 2021-07-13T00:48:59.860Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=57591194-dd13-4314-91c4-5ced9411944d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:48:59.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:59.860Z InvocationID=defd6ae5-abdc-4373-b9be-d0b17d3ebda7 2021-07-13T00:48:59.957Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=57591194-dd13-4314-91c4-5ced9411944d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:00.358Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=57591194-dd13-4314-91c4-5ced9411944d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=498 EndTimestamp=2021-07-13T00:49:00.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:48:59.860Z InvocationID=dd3b1ceb-7ab5-4f02-8c19-be9f9d18701d ResponseDesc=OK 2021-07-13T00:49:05.467Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=684a2694-7015-4445-a6a5-967eaf5472fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:05.466Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:05.466Z InvocationID=1fa6fe9a-5bad-4b0d-b95e-71197cfe40dd 2021-07-13T00:49:05.560Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=684a2694-7015-4445-a6a5-967eaf5472fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:05.919Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=684a2694-7015-4445-a6a5-967eaf5472fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=452 EndTimestamp=2021-07-13T00:49:05.918Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:05.466Z InvocationID=e2c3d439-6ac4-45f4-b29f-424f511b5efc ResponseDesc=OK 2021-07-13T00:49:06.776Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d235aff7-4416-47bc-a034-6dd5a954a0ce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:06.776Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:06.776Z InvocationID=7698e1a8-7b6f-4c1c-9cfb-bf4c92cf2491 2021-07-13T00:49:07.440Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a2e115f7-7fe4-4780-90a1-1e8f73925c36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:07.440Z InvocationID=a681535f-6ae1-44cc-bfef-f29553fa3bf1 2021-07-13T00:49:08.761Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a2e115f7-7fe4-4780-90a1-1e8f73925c36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:08.818Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d235aff7-4416-47bc-a034-6dd5a954a0ce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:08.874Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=058fb507-ad7d-4843-a654-5b2cbcc50df4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:08.874Z InvocationID=26048ef2-ddb4-4102-9f01-d0c97ba72803 2021-07-13T00:49:09.061Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=058fb507-ad7d-4843-a654-5b2cbcc50df4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:09.062Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a2e115f7-7fe4-4780-90a1-1e8f73925c36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1622 EndTimestamp=2021-07-13T00:49:09.062Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:07.440Z InvocationID=a1ea5197-839c-4c94-9211-2d04bdd69665 ResponseDesc=OK 2021-07-13T00:49:09.158Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d235aff7-4416-47bc-a034-6dd5a954a0ce InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2382 EndTimestamp=2021-07-13T00:49:09.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:06.776Z InvocationID=c083a407-6533-4d1b-b3bb-1af767d2c53d ResponseDesc=OK 2021-07-13T00:49:09.624Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=058fb507-ad7d-4843-a654-5b2cbcc50df4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=750 EndTimestamp=2021-07-13T00:49:09.624Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:08.874Z InvocationID=e07dc307-a965-4475-8058-1bb4e90c9425 ResponseDesc=OK 2021-07-13T00:49:10.322Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d385c57b-6342-428b-9581-c7a5134230f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:10.322Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:10.322Z InvocationID=ea500cac-d0c6-447f-a953-038720906418 2021-07-13T00:49:10.812Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d385c57b-6342-428b-9581-c7a5134230f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:11.059Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d385c57b-6342-428b-9581-c7a5134230f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=737 EndTimestamp=2021-07-13T00:49:11.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:10.322Z InvocationID=5c7b5b9d-fc05-41d2-90ec-de8ff31b7130 ResponseDesc=OK 2021-07-13T00:49:12.179Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5d7693b3-7e40-46a9-aac4-0240ecf490a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:12.178Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:12.178Z InvocationID=14d97674-4ad6-40ce-94aa-34595c2bfd3e 2021-07-13T00:49:12.357Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5d7693b3-7e40-46a9-aac4-0240ecf490a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:13.058Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5d7693b3-7e40-46a9-aac4-0240ecf490a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=880 EndTimestamp=2021-07-13T00:49:13.058Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:12.178Z InvocationID=f3d38100-4593-45ff-a284-8fd9cf78c2db ResponseDesc=OK 2021-07-13T00:49:15.067Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8e254155-b2ef-4e9b-8465-d3cbbe5d9643 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:15.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:15.066Z InvocationID=786d54eb-4282-4a3b-b15d-0a5175bc45c7 2021-07-13T00:49:16.060Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8e254155-b2ef-4e9b-8465-d3cbbe5d9643 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:16.419Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8e254155-b2ef-4e9b-8465-d3cbbe5d9643 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1353 EndTimestamp=2021-07-13T00:49:16.419Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:15.066Z InvocationID=391d5878-d62b-4625-905a-00529fb036d7 ResponseDesc=OK 2021-07-13T00:49:17.445Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1bfc9ee4-77dc-41a2-9760-f8379fe498ad InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:17.445Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:17.445Z InvocationID=fbedd77a-6ad4-485b-855c-bb87daade8b9 2021-07-13T00:49:18.224Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1bfc9ee4-77dc-41a2-9760-f8379fe498ad InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:18.316Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=612200fb-33a2-4ab5-ae26-b358422e99d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:18.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:18.316Z InvocationID=7aa7f0e1-97a3-4df4-97e2-bd432f05f927 2021-07-13T00:49:18.458Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=612200fb-33a2-4ab5-ae26-b358422e99d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:18.460Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1bfc9ee4-77dc-41a2-9760-f8379fe498ad InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1015 EndTimestamp=2021-07-13T00:49:18.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:17.445Z InvocationID=cc43cc9b-d236-4d96-a8fd-9f91247fbd7f ResponseDesc=OK 2021-07-13T00:49:18.857Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=612200fb-33a2-4ab5-ae26-b358422e99d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=541 EndTimestamp=2021-07-13T00:49:18.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:18.316Z InvocationID=d9a89e86-26e9-4955-bf69-888ebdc405fc ResponseDesc=OK 2021-07-13T00:49:18.873Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f1be1e2a-9a1a-46fd-81da-7bfb68211f43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:18.873Z InvocationID=f57fa4f7-239e-458c-9647-59140239a0a0 2021-07-13T00:49:19.158Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f1be1e2a-9a1a-46fd-81da-7bfb68211f43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:19.610Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f1be1e2a-9a1a-46fd-81da-7bfb68211f43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=737 EndTimestamp=2021-07-13T00:49:19.610Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:18.873Z InvocationID=91f676b8-a34a-41d4-a0bb-0a6b544a7854 ResponseDesc=OK 2021-07-13T00:49:21.262Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=689e401c-4355-49a0-9ab9-6a3a4cb356e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:21.262Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:21.262Z InvocationID=e8c8c211-74b6-486b-8e8e-9326aa5754b4 2021-07-13T00:49:21.426Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=689e401c-4355-49a0-9ab9-6a3a4cb356e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:21.659Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=689e401c-4355-49a0-9ab9-6a3a4cb356e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=397 EndTimestamp=2021-07-13T00:49:21.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:21.262Z InvocationID=ea9ba332-6aca-4733-a3ef-de1965c87577 ResponseDesc=OK 2021-07-13T00:49:24.165Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=72740cd3-6e2d-4169-b0da-314f24f6a21d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:24.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:24.165Z InvocationID=a9475cff-5d97-4aa9-8c3c-3ca1e10b8c94 2021-07-13T00:49:24.356Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=72740cd3-6e2d-4169-b0da-314f24f6a21d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:24.858Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=72740cd3-6e2d-4169-b0da-314f24f6a21d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=693 EndTimestamp=2021-07-13T00:49:24.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:24.165Z InvocationID=72d20d9a-75dd-4cc8-8ee6-e639b38e996f ResponseDesc=OK 2021-07-13T00:49:26.960Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=97628a99-ccfd-4d90-93a9-b1305b5e88af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:26.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:26.960Z InvocationID=b221afdb-49a3-4f93-9723-a3834dc31e66 2021-07-13T00:49:27.060Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=97628a99-ccfd-4d90-93a9-b1305b5e88af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:27.413Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=97628a99-ccfd-4d90-93a9-b1305b5e88af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=453 EndTimestamp=2021-07-13T00:49:27.413Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:26.960Z InvocationID=7a1a2871-1130-4743-975a-ea0ca07b9478 ResponseDesc=OK 2021-07-13T00:49:27.440Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b2cb9fb0-45ae-4697-8d71-c7ab90151aa9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:27.440Z InvocationID=f08ecd5f-4107-4f1c-8fc8-423b4f3f527c 2021-07-13T00:49:27.861Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b2cb9fb0-45ae-4697-8d71-c7ab90151aa9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:28.059Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b2cb9fb0-45ae-4697-8d71-c7ab90151aa9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=619 EndTimestamp=2021-07-13T00:49:28.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:27.440Z InvocationID=cfddc7bb-be92-4883-b782-cc4d1cfc9d84 ResponseDesc=OK 2021-07-13T00:49:28.873Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2b6c580a-5a74-48d1-bc13-fdadc9f3a9ad InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:28.873Z InvocationID=8e0db393-df54-4e17-8639-f8da05b48071 2021-07-13T00:49:29.057Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2b6c580a-5a74-48d1-bc13-fdadc9f3a9ad InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:29.757Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2b6c580a-5a74-48d1-bc13-fdadc9f3a9ad InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=884 EndTimestamp=2021-07-13T00:49:29.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:28.873Z InvocationID=ee21fd11-8e42-4d2a-942a-618840b64abd ResponseDesc=OK 2021-07-13T00:49:29.865Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b1cb6484-480a-4769-aaed-8afd885d575a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:29.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:29.864Z InvocationID=e9b8fbd1-00aa-4036-bcea-98215fcaa9da 2021-07-13T00:49:29.966Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b1cb6484-480a-4769-aaed-8afd885d575a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:30.412Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b1cb6484-480a-4769-aaed-8afd885d575a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=548 EndTimestamp=2021-07-13T00:49:30.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:29.864Z InvocationID=63b1b38c-aee7-4ed1-9928-cf85b302fa86 ResponseDesc=OK 2021-07-13T00:49:32.861Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=14f10bb8-22ec-4873-9f8a-97a12d7bd5af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:32.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:32.861Z InvocationID=11167784-e40f-4d03-9617-f274d668eb61 2021-07-13T00:49:33.062Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=14f10bb8-22ec-4873-9f8a-97a12d7bd5af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:33.159Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=14f10bb8-22ec-4873-9f8a-97a12d7bd5af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=298 EndTimestamp=2021-07-13T00:49:33.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:32.861Z InvocationID=5e6128d3-d533-493a-82d0-9b404746b8bb ResponseDesc=OK 2021-07-13T00:49:35.973Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ec77db71-ab37-4e1b-8c8a-2742237ed343 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:35.973Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:35.973Z InvocationID=08b3444a-119a-49c8-b1fd-46c6be968044 2021-07-13T00:49:36.257Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ec77db71-ab37-4e1b-8c8a-2742237ed343 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:36.661Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ec77db71-ab37-4e1b-8c8a-2742237ed343 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=688 EndTimestamp=2021-07-13T00:49:36.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:35.973Z InvocationID=97e09e27-b861-4618-9ea9-32ebebcbf41c ResponseDesc=OK 2021-07-13T00:49:37.446Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=19930d69-c006-4c3b-b777-8867c94f124f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:37.446Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:37.446Z InvocationID=e8573646-18d4-4fd6-9f84-1701c2541c90 2021-07-13T00:49:38.860Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=19930d69-c006-4c3b-b777-8867c94f124f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:38.874Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be2b6185-1bc7-431b-8e09-79071744528e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:38.874Z InvocationID=a16b23bd-f1cc-44f0-889f-794be2c39d1c 2021-07-13T00:49:39.116Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be2b6185-1bc7-431b-8e09-79071744528e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:39.213Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=19930d69-c006-4c3b-b777-8867c94f124f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1767 EndTimestamp=2021-07-13T00:49:39.213Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:37.446Z InvocationID=4de2a752-ab47-48eb-9437-86c55e463e45 ResponseDesc=OK 2021-07-13T00:49:39.360Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be2b6185-1bc7-431b-8e09-79071744528e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:49:39.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:38.874Z InvocationID=1590c6ba-8d9c-455f-9645-9829017d693f ResponseDesc=OK 2021-07-13T00:49:39.622Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=15d1d720-4da9-4eaa-85e3-e59080c1b87a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:39.622Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:39.622Z InvocationID=c4e43e9d-6dca-4c06-9d3c-72aec1d2cafb 2021-07-13T00:49:39.757Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=15d1d720-4da9-4eaa-85e3-e59080c1b87a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:40.158Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=15d1d720-4da9-4eaa-85e3-e59080c1b87a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=536 EndTimestamp=2021-07-13T00:49:40.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:39.622Z InvocationID=029f00b0-9c1f-4729-aba3-ad13a0552a91 ResponseDesc=OK 2021-07-13T00:49:42.024Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1015623a-6288-4660-9116-ed08f61d3e8e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:42.023Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:42.023Z InvocationID=dd6faf9a-fc00-48d6-8883-fb8dd7283b41 2021-07-13T00:49:42.159Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1015623a-6288-4660-9116-ed08f61d3e8e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:42.513Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1015623a-6288-4660-9116-ed08f61d3e8e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=490 EndTimestamp=2021-07-13T00:49:42.513Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:42.023Z InvocationID=35892178-1ffb-4251-8e8f-a961fd66a042 ResponseDesc=OK 2021-07-13T00:49:45.062Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1d36c5cd-5911-4af4-92d0-1f2e9bd77922 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:45.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:45.062Z InvocationID=26ef5428-b3ea-4502-a744-7c61a27a1b5a 2021-07-13T00:49:46.519Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1d36c5cd-5911-4af4-92d0-1f2e9bd77922 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:46.760Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1d36c5cd-5911-4af4-92d0-1f2e9bd77922 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1698 EndTimestamp=2021-07-13T00:49:46.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:45.062Z InvocationID=2132dc6d-cbd0-40a2-9d07-0636f5ebf92d ResponseDesc=OK 2021-07-13T00:49:47.443Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=11b8e489-4199-4656-9be6-2701511dc606 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:47.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:47.443Z InvocationID=91002df2-5005-4252-8284-d29f7e0bf345 2021-07-13T00:49:47.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=11b8e489-4199-4656-9be6-2701511dc606 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:48.157Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=11b8e489-4199-4656-9be6-2701511dc606 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=714 EndTimestamp=2021-07-13T00:49:48.157Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:47.443Z InvocationID=0296ded9-2762-45ff-8536-38422fd6e30c ResponseDesc=OK 2021-07-13T00:49:48.165Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=71071c41-8aa6-433e-8ee7-271888a88f28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:48.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:48.165Z InvocationID=39a30a8b-1bc3-4d3a-88c6-64fd8f63ab66 2021-07-13T00:49:48.260Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=71071c41-8aa6-433e-8ee7-271888a88f28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:48.623Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=71071c41-8aa6-433e-8ee7-271888a88f28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=458 EndTimestamp=2021-07-13T00:49:48.623Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:48.165Z InvocationID=4c92d309-e17d-4b61-b71b-d904c27451d0 ResponseDesc=OK 2021-07-13T00:49:48.873Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c934acb2-bb02-4804-8eea-a8a8ff45ecb9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:48.873Z InvocationID=eafdc967-1883-493a-9bb5-f91ecbab493d 2021-07-13T00:49:49.226Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c934acb2-bb02-4804-8eea-a8a8ff45ecb9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:49.459Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c934acb2-bb02-4804-8eea-a8a8ff45ecb9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=586 EndTimestamp=2021-07-13T00:49:49.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:48.873Z InvocationID=d7176647-7608-4b22-b8a0-658773b51284 ResponseDesc=OK 2021-07-13T00:49:50.872Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=93eb16a5-9fac-471f-9918-49e6746f7d19 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:50.872Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:50.872Z InvocationID=d4deb452-a10d-4e74-a41b-992eb409c063 2021-07-13T00:49:51.077Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=93eb16a5-9fac-471f-9918-49e6746f7d19 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:51.458Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=93eb16a5-9fac-471f-9918-49e6746f7d19 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=585 EndTimestamp=2021-07-13T00:49:51.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:50.872Z InvocationID=6aaec4cc-0bb7-4eed-9c78-9c8f6b7b002d ResponseDesc=OK 2021-07-13T00:49:53.671Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=20af5cc1-b451-461d-bb97-1d5a22b23d4b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:53.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:53.671Z InvocationID=efc31269-6fd3-4127-9eb1-a2974271da05 2021-07-13T00:49:53.862Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=20af5cc1-b451-461d-bb97-1d5a22b23d4b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:54.031Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=20af5cc1-b451-461d-bb97-1d5a22b23d4b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=360 EndTimestamp=2021-07-13T00:49:54.031Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:53.671Z InvocationID=c337203a-de14-4dad-9f02-360504491e70 ResponseDesc=OK 2021-07-13T00:49:56.670Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6a1a6cd2-9609-44f9-bce3-3120aa41dc5e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:56.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:56.670Z InvocationID=2820cbc6-b7b0-4ecd-b8cd-9f7258a5db03 2021-07-13T00:49:56.911Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6a1a6cd2-9609-44f9-bce3-3120aa41dc5e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:57.159Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6a1a6cd2-9609-44f9-bce3-3120aa41dc5e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=489 EndTimestamp=2021-07-13T00:49:57.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:56.670Z InvocationID=f510a8af-8a1f-41a0-920f-3e365be8f083 ResponseDesc=OK 2021-07-13T00:49:57.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f1d12c8-8fb4-4cce-b335-960e7fc14154 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:57.440Z InvocationID=d3b163db-420e-4b56-a934-d8a2a662af8a 2021-07-13T00:49:57.856Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f1d12c8-8fb4-4cce-b335-960e7fc14154 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:58.158Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0f1d12c8-8fb4-4cce-b335-960e7fc14154 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=718 EndTimestamp=2021-07-13T00:49:58.158Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:57.440Z InvocationID=424a0447-1c57-490e-b97f-aca84637fb39 ResponseDesc=OK 2021-07-13T00:49:58.875Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=89cda496-8c38-4ead-a488-e9d1f2b3281c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:49:58.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:58.875Z InvocationID=ad359bd6-65fc-4efc-9d35-a43768582ea3 2021-07-13T00:49:59.059Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=89cda496-8c38-4ead-a488-e9d1f2b3281c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:49:59.416Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=89cda496-8c38-4ead-a488-e9d1f2b3281c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=541 EndTimestamp=2021-07-13T00:49:59.416Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:49:58.875Z InvocationID=baaf57af-0c07-4e13-8420-290ba84f8229 ResponseDesc=OK 2021-07-13T00:50:00.064Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2b44b165-7c99-4ddc-8034-6820c9817bef InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:00.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:00.064Z InvocationID=1eeaba73-fc41-45c8-9760-bfc356e0a1fb 2021-07-13T00:50:00.622Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2b44b165-7c99-4ddc-8034-6820c9817bef InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:00.764Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2b44b165-7c99-4ddc-8034-6820c9817bef InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=700 EndTimestamp=2021-07-13T00:50:00.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:00.064Z InvocationID=4bafc5a6-705c-4f89-94fa-68ee7cc66772 ResponseDesc=OK 2021-07-13T00:50:02.875Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cc752f87-a99d-4524-a6f0-1499be6a9308 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:02.875Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:02.875Z InvocationID=83d6c571-ee59-4b2b-a6fd-b959691b0ae8 2021-07-13T00:50:03.226Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cc752f87-a99d-4524-a6f0-1499be6a9308 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:04.457Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cc752f87-a99d-4524-a6f0-1499be6a9308 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1582 EndTimestamp=2021-07-13T00:50:04.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:02.875Z InvocationID=8e8e7a2a-380c-4764-ab8e-4d07af1dc602 ResponseDesc=OK 2021-07-13T00:50:05.868Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5ac8917c-e03e-4d9d-8ec1-e090be300343 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:05.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:05.868Z InvocationID=ded5c1b5-260f-4a10-aeca-e82c03bb884d 2021-07-13T00:50:05.965Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5ac8917c-e03e-4d9d-8ec1-e090be300343 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:06.417Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5ac8917c-e03e-4d9d-8ec1-e090be300343 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=549 EndTimestamp=2021-07-13T00:50:06.417Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:05.868Z InvocationID=fb86e11c-1903-46a9-8f95-0ceffc8acd42 ResponseDesc=OK 2021-07-13T00:50:07.440Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=21fdf7b5-4e17-4326-a739-9a28d4a75264 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:07.440Z InvocationID=372857ac-0422-4a99-aedb-ed198a1d00e3 2021-07-13T00:50:07.612Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=21fdf7b5-4e17-4326-a739-9a28d4a75264 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:07.859Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=21fdf7b5-4e17-4326-a739-9a28d4a75264 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=419 EndTimestamp=2021-07-13T00:50:07.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:07.440Z InvocationID=6fe7e23a-0593-44e8-bbec-ccc11a54785b ResponseDesc=OK 2021-07-13T00:50:08.874Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1bba0d39-e00b-4cee-bf05-28fd17142d01 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:08.874Z InvocationID=4568d50b-954f-4bdf-83ba-309dd554aea0 2021-07-13T00:50:09.065Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2db060eb-e1b4-4021-b41b-9010a08b5a12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:09.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:09.065Z InvocationID=eab155c0-b1b6-4b04-9694-52d71e8d40bc 2021-07-13T00:50:09.156Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1bba0d39-e00b-4cee-bf05-28fd17142d01 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:09.317Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2db060eb-e1b4-4021-b41b-9010a08b5a12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:09.368Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1bba0d39-e00b-4cee-bf05-28fd17142d01 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=494 EndTimestamp=2021-07-13T00:50:09.368Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:08.874Z InvocationID=671bd35c-154e-4116-ad30-2f4bb565dd43 ResponseDesc=OK 2021-07-13T00:50:09.468Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2db060eb-e1b4-4021-b41b-9010a08b5a12 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=403 EndTimestamp=2021-07-13T00:50:09.468Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:09.065Z InvocationID=d682bed6-9911-4d3b-9500-978fb95800ca ResponseDesc=OK 2021-07-13T00:50:11.720Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9d442c31-aaf6-4c1b-932d-9753649d7fb3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:11.720Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:11.720Z InvocationID=5968ede8-2fc0-464f-b501-f06776d88e9c 2021-07-13T00:50:11.922Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9d442c31-aaf6-4c1b-932d-9753649d7fb3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:12.160Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9d442c31-aaf6-4c1b-932d-9753649d7fb3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:50:12.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:11.720Z InvocationID=60a41ead-45b7-4a39-857a-52ccf9a56e0e ResponseDesc=OK 2021-07-13T00:50:15.025Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0c81d1d6-3af0-43bf-a1b0-318e1865702f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:15.024Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:15.024Z InvocationID=dfc278fd-6e28-4df4-a714-c1ba21e206d5 2021-07-13T00:50:15.157Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0c81d1d6-3af0-43bf-a1b0-318e1865702f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:15.462Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0c81d1d6-3af0-43bf-a1b0-318e1865702f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=438 EndTimestamp=2021-07-13T00:50:15.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:15.024Z InvocationID=640d275b-dd3b-4348-8665-51f86a332842 ResponseDesc=OK 2021-07-13T00:50:17.439Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cb389b4c-1c88-49ff-8de2-3ea199657073 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:17.439Z InvocationID=e749b38a-169d-4848-8452-bd92ca6580a2 2021-07-13T00:50:17.559Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cb389b4c-1c88-49ff-8de2-3ea199657073 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:17.916Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cb389b4c-1c88-49ff-8de2-3ea199657073 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=476 EndTimestamp=2021-07-13T00:50:17.915Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:17.439Z InvocationID=6c90db0f-e919-4f85-8a31-69a85be4a4dd ResponseDesc=OK 2021-07-13T00:50:18.064Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7c303821-4772-4823-8029-97d4cc136ee6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:18.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:18.064Z InvocationID=c59bc809-6b53-47ca-a514-adf398a94923 2021-07-13T00:50:18.314Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7c303821-4772-4823-8029-97d4cc136ee6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:18.560Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7c303821-4772-4823-8029-97d4cc136ee6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:50:18.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:18.064Z InvocationID=a95c76fc-c7eb-4597-bf5e-7ed361a62ccc ResponseDesc=OK 2021-07-13T00:50:18.874Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7517a998-fac9-4aec-98f3-25d324e6f9c4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:18.874Z InvocationID=57628c29-226c-432c-8ff5-c11a0dca70ac 2021-07-13T00:50:19.058Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7517a998-fac9-4aec-98f3-25d324e6f9c4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:20.757Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7517a998-fac9-4aec-98f3-25d324e6f9c4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1883 EndTimestamp=2021-07-13T00:50:20.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:18.874Z InvocationID=b5a27de5-cfa8-4c67-837d-488e69c4a30b ResponseDesc=OK 2021-07-13T00:50:21.746Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e1ed15f3-a1c6-43e0-8d68-8a121846ee3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:21.746Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:21.746Z InvocationID=88b34252-5ea0-4e6e-a580-694afcfc5042 2021-07-13T00:50:21.866Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e1ed15f3-a1c6-43e0-8d68-8a121846ee3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:22.185Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e1ed15f3-a1c6-43e0-8d68-8a121846ee3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:50:22.185Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:21.746Z InvocationID=1cca3514-f68e-43cf-8176-cf978440fe26 ResponseDesc=OK 2021-07-13T00:50:23.672Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=602a9b82-0129-4459-8dc6-b18bf3c624b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:23.672Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:23.672Z InvocationID=1b342e73-0a0b-4c67-bcff-606af1fb83ce 2021-07-13T00:50:24.215Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=602a9b82-0129-4459-8dc6-b18bf3c624b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:24.660Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=602a9b82-0129-4459-8dc6-b18bf3c624b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=988 EndTimestamp=2021-07-13T00:50:24.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:23.672Z InvocationID=1261d323-04c8-43ae-9187-6f2af2863102 ResponseDesc=OK 2021-07-13T00:50:27.068Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2a7784f0-adfd-4e85-b9e3-34f60c3d487f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:27.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:27.068Z InvocationID=15b94321-6510-43c0-81bf-5c4613952742 2021-07-13T00:50:27.160Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2a7784f0-adfd-4e85-b9e3-34f60c3d487f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:27.357Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2a7784f0-adfd-4e85-b9e3-34f60c3d487f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=289 EndTimestamp=2021-07-13T00:50:27.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:27.068Z InvocationID=3cdc6e7d-bfa6-4151-89d9-f8e72f10996b ResponseDesc=OK 2021-07-13T00:50:27.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=14fe0748-b6c7-4608-b920-bd88da8a8432 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:27.439Z InvocationID=59e36dbf-cc21-4db8-bc1c-b6598b0a9910 2021-07-13T00:50:27.560Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=14fe0748-b6c7-4608-b920-bd88da8a8432 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:27.719Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=14fe0748-b6c7-4608-b920-bd88da8a8432 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=280 EndTimestamp=2021-07-13T00:50:27.719Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:27.439Z InvocationID=109fa7e1-2acf-4da1-8fc0-4641b5b63c63 ResponseDesc=OK 2021-07-13T00:50:28.877Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d09d1405-5807-4297-916d-506f47a23147 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:28.877Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:28.877Z InvocationID=17008f26-fb34-423a-acac-72d3b2e34b78 2021-07-13T00:50:29.414Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d09d1405-5807-4297-916d-506f47a23147 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:30.159Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d09d1405-5807-4297-916d-506f47a23147 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1282 EndTimestamp=2021-07-13T00:50:30.159Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:28.877Z InvocationID=ed7096a8-5d7f-40c0-8fa4-d4568ec307fc ResponseDesc=OK 2021-07-13T00:50:30.568Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4ae123ac-619a-443e-9c43-3b92de99c9b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:30.568Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:30.568Z InvocationID=4632ae1c-475b-42b9-9eaa-c572c6dc56d4 2021-07-13T00:50:30.671Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4ae123ac-619a-443e-9c43-3b92de99c9b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:30.965Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4ae123ac-619a-443e-9c43-3b92de99c9b0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=397 EndTimestamp=2021-07-13T00:50:30.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:30.568Z InvocationID=0848dd96-c6e0-4091-8056-9507adcb9f71 ResponseDesc=OK 2021-07-13T00:50:32.578Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dfc2576d-83ff-4e27-b896-a23c35f35fd8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:32.578Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:32.578Z InvocationID=10986b6c-78a8-40b3-b689-94323bbb8ab0 2021-07-13T00:50:32.662Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dfc2576d-83ff-4e27-b896-a23c35f35fd8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:33.165Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dfc2576d-83ff-4e27-b896-a23c35f35fd8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=587 EndTimestamp=2021-07-13T00:50:33.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:32.578Z InvocationID=a33aa1b7-f7f7-4a62-8bd5-d702a34d1fd8 ResponseDesc=OK 2021-07-13T00:50:35.661Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3be249c5-45cc-4c01-a4ec-e75dbc01d71f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:35.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:35.661Z InvocationID=5d0b30e2-81ec-444f-a690-dcdd48faa7ed 2021-07-13T00:50:35.974Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3be249c5-45cc-4c01-a4ec-e75dbc01d71f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:36.260Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3be249c5-45cc-4c01-a4ec-e75dbc01d71f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=599 EndTimestamp=2021-07-13T00:50:36.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:35.661Z InvocationID=aa6121ee-4de8-4a1d-a549-c3ec2d6147a2 ResponseDesc=OK 2021-07-13T00:50:37.440Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fa99869d-5943-4984-b2b3-d356865da43e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:37.440Z InvocationID=5213a51e-1d14-43f1-99ce-986078602ba2 2021-07-13T00:50:37.556Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fa99869d-5943-4984-b2b3-d356865da43e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:37.765Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fa99869d-5943-4984-b2b3-d356865da43e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=325 EndTimestamp=2021-07-13T00:50:37.765Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:37.440Z InvocationID=633edb35-dfdb-4717-ad7c-48a9256ba388 ResponseDesc=OK 2021-07-13T00:50:38.866Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=28b2f5e4-49ed-47c8-aefc-f45b9eb5535d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:38.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:38.866Z InvocationID=5584cb26-c95f-4a48-9327-7267473be09c 2021-07-13T00:50:38.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=620fd272-92be-4727-9ca9-fdb98c5796a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:38.873Z InvocationID=44d4b0e6-9e9a-4824-8437-abcbdcdfaa85 2021-07-13T00:50:38.964Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=28b2f5e4-49ed-47c8-aefc-f45b9eb5535d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:39.058Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=620fd272-92be-4727-9ca9-fdb98c5796a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:39.162Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=620fd272-92be-4727-9ca9-fdb98c5796a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=289 EndTimestamp=2021-07-13T00:50:39.162Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:38.873Z InvocationID=83a6cbd5-9ab3-4005-b6a0-001891f5ec7e ResponseDesc=OK 2021-07-13T00:50:39.189Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=28b2f5e4-49ed-47c8-aefc-f45b9eb5535d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=323 EndTimestamp=2021-07-13T00:50:39.189Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:38.866Z InvocationID=4fbdf403-3277-4e95-ac62-a90f1a14cee7 ResponseDesc=OK 2021-07-13T00:50:41.765Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3bc6c782-e560-488b-ac48-abdbfafe216b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:41.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:41.765Z InvocationID=0fd3e6cf-7186-426c-a6e7-c49b7204a8d9 2021-07-13T00:50:41.868Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3bc6c782-e560-488b-ac48-abdbfafe216b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:42.260Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3bc6c782-e560-488b-ac48-abdbfafe216b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=494 EndTimestamp=2021-07-13T00:50:42.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:41.765Z InvocationID=94cd098d-c912-4e66-ad95-77d64ec2864b ResponseDesc=OK 2021-07-13T00:50:44.762Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=34ffa89d-fa58-445c-ab5d-b4ed5e0514c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:44.762Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:44.762Z InvocationID=a696b405-17a8-4668-a8cc-f8bd3eebb217 2021-07-13T00:50:44.977Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=34ffa89d-fa58-445c-ab5d-b4ed5e0514c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:45.829Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=34ffa89d-fa58-445c-ab5d-b4ed5e0514c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1067 EndTimestamp=2021-07-13T00:50:45.829Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:44.762Z InvocationID=40d3f245-ea08-443b-ab53-52ab06a0470b ResponseDesc=OK 2021-07-13T00:50:47.440Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2fe0c72c-7f76-4486-a996-71ed687880ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:47.440Z InvocationID=4010256e-978a-496f-b093-6c2f7faf9395 2021-07-13T00:50:47.734Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2fe0c72c-7f76-4486-a996-71ed687880ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:47.824Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1dfa99ed-0865-4f51-9696-0e5b85326ed8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:47.824Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:47.824Z InvocationID=007c759a-6e97-4f2d-8af3-045c3788dafe 2021-07-13T00:50:47.957Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1dfa99ed-0865-4f51-9696-0e5b85326ed8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:47.959Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2fe0c72c-7f76-4486-a996-71ed687880ac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=519 EndTimestamp=2021-07-13T00:50:47.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:47.440Z InvocationID=15bb53af-83db-438b-9eb6-d6fab5a0b85e ResponseDesc=OK 2021-07-13T00:50:48.462Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1dfa99ed-0865-4f51-9696-0e5b85326ed8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=638 EndTimestamp=2021-07-13T00:50:48.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:47.824Z InvocationID=3642e108-efee-4f75-b06a-6a0e07fe93f5 ResponseDesc=OK 2021-07-13T00:50:48.874Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=49257c2e-5c57-4112-9747-811cbb733356 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:48.874Z InvocationID=e327a325-4602-4488-9bd0-f579c418ed2a 2021-07-13T00:50:49.060Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=49257c2e-5c57-4112-9747-811cbb733356 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:49.421Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=49257c2e-5c57-4112-9747-811cbb733356 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=546 EndTimestamp=2021-07-13T00:50:49.420Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:48.874Z InvocationID=8db17e05-70ea-44dd-a5e7-6fa5ce989d84 ResponseDesc=OK 2021-07-13T00:50:50.971Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81f18307-052f-42b1-8fe2-5093f27d5e4f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:50.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:50.971Z InvocationID=8ec223e7-b37c-400d-a13a-ebfbf78bae38 2021-07-13T00:50:51.386Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81f18307-052f-42b1-8fe2-5093f27d5e4f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:51.659Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=81f18307-052f-42b1-8fe2-5093f27d5e4f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=688 EndTimestamp=2021-07-13T00:50:51.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:50.971Z InvocationID=cffac44d-6f4f-4c49-a697-74d717ee3b19 ResponseDesc=OK 2021-07-13T00:50:53.765Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=22b9eb46-0c37-4c92-b554-68763218cd83 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:53.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:53.765Z InvocationID=3cfff723-9857-40fe-bf54-84f82d413399 2021-07-13T00:50:53.957Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=22b9eb46-0c37-4c92-b554-68763218cd83 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:54.557Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=22b9eb46-0c37-4c92-b554-68763218cd83 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=792 EndTimestamp=2021-07-13T00:50:54.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:53.765Z InvocationID=4c035a9c-940b-4b3c-af5b-50dc15b9cc41 ResponseDesc=OK 2021-07-13T00:50:56.872Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6fb0cb7b-b8df-4591-a765-4397a2df0234 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:56.872Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:56.872Z InvocationID=fcda29c8-88d1-4716-a3b8-df3851347fba 2021-07-13T00:50:56.982Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6fb0cb7b-b8df-4591-a765-4397a2df0234 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:57.412Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6fb0cb7b-b8df-4591-a765-4397a2df0234 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=540 EndTimestamp=2021-07-13T00:50:57.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:56.872Z InvocationID=c8c08266-6db5-4ea4-81ae-dfde010e4442 ResponseDesc=OK 2021-07-13T00:50:57.438Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ee9ce7c9-098a-4415-bda4-b19006b493c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:57.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:57.438Z InvocationID=96280976-3acc-4d09-8eee-4318c52e55bb 2021-07-13T00:50:58.226Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ee9ce7c9-098a-4415-bda4-b19006b493c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:58.772Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ee9ce7c9-098a-4415-bda4-b19006b493c7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1334 EndTimestamp=2021-07-13T00:50:58.772Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:57.438Z InvocationID=5f7913c9-3867-46d7-aaf3-2b03c54cfa9e ResponseDesc=OK 2021-07-13T00:50:58.873Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=91cb001c-c6ba-4903-b9c7-f1a9e9190687 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:58.873Z InvocationID=98f049d4-74d9-4e26-aa1b-31442cd58e5a 2021-07-13T00:50:59.057Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=91cb001c-c6ba-4903-b9c7-f1a9e9190687 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:50:59.458Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=91cb001c-c6ba-4903-b9c7-f1a9e9190687 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=584 EndTimestamp=2021-07-13T00:50:59.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:58.873Z InvocationID=e98f59ac-385c-4cd3-82da-888e1b5e0adb ResponseDesc=OK 2021-07-13T00:50:59.871Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b8abcb4e-2226-4d6b-b48a-695eeea3db15 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:50:59.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:59.871Z InvocationID=74c43410-0139-4df2-912e-d161fc87b30f 2021-07-13T00:51:00.063Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b8abcb4e-2226-4d6b-b48a-695eeea3db15 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:00.423Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b8abcb4e-2226-4d6b-b48a-695eeea3db15 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=552 EndTimestamp=2021-07-13T00:51:00.423Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:50:59.871Z InvocationID=aa8ec365-bb6d-4a14-a88d-02941ebfb9d2 ResponseDesc=OK 2021-07-13T00:51:02.972Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c5503bc2-ad61-4035-a391-50496976e483 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:02.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:02.972Z InvocationID=735c18c8-2fc8-44e4-bf47-9a933817a248 2021-07-13T00:51:03.611Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c5503bc2-ad61-4035-a391-50496976e483 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:04.160Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c5503bc2-ad61-4035-a391-50496976e483 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1188 EndTimestamp=2021-07-13T00:51:04.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:02.972Z InvocationID=eeac2feb-b8f8-46b9-b3df-3579ce03a38f ResponseDesc=OK 2021-07-13T00:51:06.617Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=55752164-1d1b-410a-b29f-f3d79ea173f6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:06.617Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:06.617Z InvocationID=25543453-77b6-405d-8671-03d3716977b3 2021-07-13T00:51:06.665Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=55752164-1d1b-410a-b29f-f3d79ea173f6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:06.857Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=55752164-1d1b-410a-b29f-f3d79ea173f6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=240 EndTimestamp=2021-07-13T00:51:06.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:06.617Z InvocationID=ebf4ea60-310a-4d93-9e51-2f956e6b1138 ResponseDesc=OK 2021-07-13T00:51:07.440Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5bfdfa75-0a4e-4c36-bef2-b65738b2cbdb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:07.440Z InvocationID=b0ab14e2-2a51-4f04-9824-096b04306cc9 2021-07-13T00:51:07.559Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5bfdfa75-0a4e-4c36-bef2-b65738b2cbdb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:07.912Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5bfdfa75-0a4e-4c36-bef2-b65738b2cbdb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=471 EndTimestamp=2021-07-13T00:51:07.911Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:07.440Z InvocationID=05c8006b-602b-45f0-9932-ba432bf5f71d ResponseDesc=OK 2021-07-13T00:51:08.783Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b088076a-0a15-498a-9414-b88102b2275f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:08.783Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:08.783Z InvocationID=4f47a5bd-7e62-47e2-996f-930d57edb35b 2021-07-13T00:51:08.874Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=94af9c80-3a24-42f2-84ea-fc46f864b688 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:08.873Z InvocationID=8a576a1d-84ab-417c-9af1-cf1e27888084 2021-07-13T00:51:09.020Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b088076a-0a15-498a-9414-b88102b2275f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:09.079Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=94af9c80-3a24-42f2-84ea-fc46f864b688 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:09.459Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=94af9c80-3a24-42f2-84ea-fc46f864b688 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=586 EndTimestamp=2021-07-13T00:51:09.459Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:08.873Z InvocationID=ff787bd7-738f-47d6-a94e-b0e09e35dcd9 ResponseDesc=OK 2021-07-13T00:51:09.857Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b088076a-0a15-498a-9414-b88102b2275f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1074 EndTimestamp=2021-07-13T00:51:09.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:08.783Z InvocationID=8d05ce33-b438-4a7c-8d64-12b5aaf4399a ResponseDesc=OK 2021-07-13T00:51:11.772Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8693f89b-c7f4-4213-8a5f-4008d849b97a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:11.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:11.772Z InvocationID=d9f5c615-c721-4fa9-a22d-af8a8372596d 2021-07-13T00:51:11.860Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8693f89b-c7f4-4213-8a5f-4008d849b97a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:12.123Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8693f89b-c7f4-4213-8a5f-4008d849b97a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=351 EndTimestamp=2021-07-13T00:51:12.123Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:11.772Z InvocationID=cdf81ce4-47c4-420f-8628-1ae048a9599e ResponseDesc=OK 2021-07-13T00:51:14.864Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ecbc0fc1-d1c2-4574-bd37-850dce8d2384 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:14.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:14.864Z InvocationID=8dea190c-e935-4eb8-804b-5bc024b787e8 2021-07-13T00:51:15.215Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ecbc0fc1-d1c2-4574-bd37-850dce8d2384 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:15.360Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ecbc0fc1-d1c2-4574-bd37-850dce8d2384 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:51:15.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:14.864Z InvocationID=2c87cfe2-c27f-43d6-9556-7a5f81796d65 ResponseDesc=OK 2021-07-13T00:51:17.439Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=abf020f6-4f7d-4327-851d-a3c755fd5992 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:17.439Z InvocationID=74bfbead-0406-474c-8fbf-fabe4547aeaa 2021-07-13T00:51:17.557Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=abf020f6-4f7d-4327-851d-a3c755fd5992 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:18.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=89d9ff64-8223-4562-b89b-2cb7ebfccbbc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:18.873Z InvocationID=c0a89386-8b9b-423f-98c0-118f7dfd7f47 2021-07-13T00:51:18.961Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=89d9ff64-8223-4562-b89b-2cb7ebfccbbc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:22.760Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=abf020f6-4f7d-4327-851d-a3c755fd5992 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5321 EndTimestamp=2021-07-13T00:51:22.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:17.439Z InvocationID=5529d985-98f9-488a-8855-63b435d1a7d2 ResponseDesc=OK 2021-07-13T00:51:22.922Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=07c8967e-2ade-4666-90d9-ca52f507f671 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:22.922Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:22.922Z InvocationID=14d9c098-a2f0-42fa-affb-951f6ad911bb 2021-07-13T00:51:23.014Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=89d9ff64-8223-4562-b89b-2cb7ebfccbbc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4141 EndTimestamp=2021-07-13T00:51:23.014Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:18.873Z InvocationID=8934f3c7-f694-4578-91ee-5931994c96a6 ResponseDesc=OK 2021-07-13T00:51:24.130Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=07c8967e-2ade-4666-90d9-ca52f507f671 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:24.360Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=07c8967e-2ade-4666-90d9-ca52f507f671 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1438 EndTimestamp=2021-07-13T00:51:24.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:22.922Z InvocationID=7c6fb0a4-65f8-4938-810e-8d6dd010bb4e ResponseDesc=OK 2021-07-13T00:51:26.233Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=55b240ad-100d-4b09-8e04-2e2037499d1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:26.233Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:26.233Z InvocationID=b6baf21e-d5fc-4b60-862f-8d68399f1bf2 2021-07-13T00:51:26.356Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=55b240ad-100d-4b09-8e04-2e2037499d1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:26.957Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=55b240ad-100d-4b09-8e04-2e2037499d1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=724 EndTimestamp=2021-07-13T00:51:26.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:26.233Z InvocationID=ba801966-f011-4a95-bb41-f1dc3c926603 ResponseDesc=OK 2021-07-13T00:51:27.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=94720a8d-c3d9-410a-9f57-8fe47eaab659 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:27.439Z InvocationID=68fff819-a756-449f-8d18-24e23b10770d 2021-07-13T00:51:27.759Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=94720a8d-c3d9-410a-9f57-8fe47eaab659 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:28.123Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=94720a8d-c3d9-410a-9f57-8fe47eaab659 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=683 EndTimestamp=2021-07-13T00:51:28.122Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:27.439Z InvocationID=0a945115-4551-4645-8617-2947f7665f47 ResponseDesc=OK 2021-07-13T00:51:28.176Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=11f1dbd9-59c0-4896-b34a-241221554117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:28.176Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:28.176Z InvocationID=fb133bd7-6530-4ca6-9fb8-351e8f24ff2d 2021-07-13T00:51:28.418Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=11f1dbd9-59c0-4896-b34a-241221554117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:28.570Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=11f1dbd9-59c0-4896-b34a-241221554117 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=394 EndTimestamp=2021-07-13T00:51:28.570Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:28.176Z InvocationID=c5f65939-40ca-4b7a-a41c-a0f9d8856d6b ResponseDesc=OK 2021-07-13T00:51:28.872Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d93c9cbd-d0c2-429c-9720-db7487d3dba7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:28.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:28.872Z InvocationID=ed28276b-83d0-4ecd-ae2c-b45bc85d2129 2021-07-13T00:51:29.056Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d93c9cbd-d0c2-429c-9720-db7487d3dba7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:29.357Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d93c9cbd-d0c2-429c-9720-db7487d3dba7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=485 EndTimestamp=2021-07-13T00:51:29.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:28.872Z InvocationID=90b927ba-1d1f-4923-84e2-2d447fec0fc8 ResponseDesc=OK 2021-07-13T00:51:29.766Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1a61c395-2bd1-41e2-b0d3-569d02776285 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:29.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:29.766Z InvocationID=81bcd3b4-5f07-45fe-ab51-5edbe77cdff2 2021-07-13T00:51:29.859Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1a61c395-2bd1-41e2-b0d3-569d02776285 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:30.919Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1a61c395-2bd1-41e2-b0d3-569d02776285 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1153 EndTimestamp=2021-07-13T00:51:30.919Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:29.766Z InvocationID=e98e2dac-10d1-4ced-921f-1394039aeff7 ResponseDesc=OK 2021-07-13T00:51:31.668Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ffd5a810-f849-4d19-906f-42ac1308ee92 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:31.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:31.668Z InvocationID=d8398c89-5376-49b8-85ef-8724e1ba6d02 2021-07-13T00:51:32.112Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ffd5a810-f849-4d19-906f-42ac1308ee92 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:32.359Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ffd5a810-f849-4d19-906f-42ac1308ee92 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=691 EndTimestamp=2021-07-13T00:51:32.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:31.668Z InvocationID=20c49240-7274-41f5-bad3-efcc0d859a8d ResponseDesc=OK 2021-07-13T00:51:33.166Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7502e4f7-4724-4886-b6e9-461dafbfca14 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:33.166Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:33.166Z InvocationID=ce4405de-5461-41bc-88d9-dca7df69e265 2021-07-13T00:51:33.356Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7502e4f7-4724-4886-b6e9-461dafbfca14 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:33.757Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7502e4f7-4724-4886-b6e9-461dafbfca14 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=591 EndTimestamp=2021-07-13T00:51:33.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:33.166Z InvocationID=6bfdcb7e-ed9f-4a13-8277-4b837638aa70 ResponseDesc=OK 2021-07-13T00:51:36.826Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=db37509a-9075-4070-b28a-276a141764f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:36.826Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:36.826Z InvocationID=851f545b-44e0-4b53-abb3-349bed6a1c45 2021-07-13T00:51:37.060Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=db37509a-9075-4070-b28a-276a141764f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:37.439Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=922693b6-088d-4ba1-b85c-923411e565a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:37.439Z InvocationID=48ad0664-4567-44d1-b7ee-63c586c98328 2021-07-13T00:51:38.119Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=922693b6-088d-4ba1-b85c-923411e565a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:38.119Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=db37509a-9075-4070-b28a-276a141764f0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1293 EndTimestamp=2021-07-13T00:51:38.119Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:36.826Z InvocationID=39487157-ab78-4dde-b4fd-47b96ea45b80 ResponseDesc=OK 2021-07-13T00:51:38.361Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=922693b6-088d-4ba1-b85c-923411e565a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=922 EndTimestamp=2021-07-13T00:51:38.361Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:37.439Z InvocationID=6715573d-c4be-4e41-a04e-cc0d4eb43fb5 ResponseDesc=OK 2021-07-13T00:51:38.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8feb9568-6e74-4caa-a0ad-ac48997e3e0e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:38.873Z InvocationID=9dbcc70d-c57f-4af1-ae22-ad700a9b7062 2021-07-13T00:51:39.131Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=39f4adf8-b809-4105-9ba2-1f5fb845ca19 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:39.131Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:39.131Z InvocationID=7f56fd56-7007-43da-bea5-cb048fe3c275 2021-07-13T00:51:39.161Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8feb9568-6e74-4caa-a0ad-ac48997e3e0e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:39.759Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8feb9568-6e74-4caa-a0ad-ac48997e3e0e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=886 EndTimestamp=2021-07-13T00:51:39.759Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:38.873Z InvocationID=69e2a76e-aa2e-43d3-bccf-dedd93f2453f ResponseDesc=OK 2021-07-13T00:51:39.815Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=39f4adf8-b809-4105-9ba2-1f5fb845ca19 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:40.221Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=39f4adf8-b809-4105-9ba2-1f5fb845ca19 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1090 EndTimestamp=2021-07-13T00:51:40.221Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:39.131Z InvocationID=c5288c86-a6ea-40bf-a904-b3f5fff7717b ResponseDesc=OK 2021-07-13T00:51:42.759Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fac39175-3408-466c-96d4-a3120cba4ae9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:42.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:42.759Z InvocationID=eb9c42cb-4b20-4c46-b462-5b5e1cd9e0dd 2021-07-13T00:51:43.823Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fac39175-3408-466c-96d4-a3120cba4ae9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:44.061Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fac39175-3408-466c-96d4-a3120cba4ae9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1302 EndTimestamp=2021-07-13T00:51:44.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:42.759Z InvocationID=ca4e68e3-87d8-4216-a312-0f152fb9d106 ResponseDesc=OK 2021-07-13T00:51:45.360Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=91e7197e-9eef-4625-8e27-cee2f1bb2900 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:45.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:45.360Z InvocationID=b51634f2-2ffe-4a73-b19d-db6dce8257b9 2021-07-13T00:51:45.456Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=91e7197e-9eef-4625-8e27-cee2f1bb2900 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:45.757Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=91e7197e-9eef-4625-8e27-cee2f1bb2900 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=397 EndTimestamp=2021-07-13T00:51:45.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:45.360Z InvocationID=1ad855a4-8990-47f4-8e24-4fa916bd435c ResponseDesc=OK 2021-07-13T00:51:47.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8f29b708-6179-418a-9744-3764dba1f91b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:47.439Z InvocationID=8df8b741-e09b-4b94-a116-5085eda74357 2021-07-13T00:51:47.467Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8f29b708-6179-418a-9744-3764dba1f91b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:47.778Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8f29b708-6179-418a-9744-3764dba1f91b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=339 EndTimestamp=2021-07-13T00:51:47.778Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:47.439Z InvocationID=54e586c8-ff4b-4cef-940f-07bdba11538b ResponseDesc=OK 2021-07-13T00:51:47.866Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4fff5f46-a687-42ef-a2c4-f42f60f6878f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:47.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:47.865Z InvocationID=b33c168e-ce00-4567-9067-a29f9716c060 2021-07-13T00:51:47.971Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4fff5f46-a687-42ef-a2c4-f42f60f6878f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:48.359Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4fff5f46-a687-42ef-a2c4-f42f60f6878f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=494 EndTimestamp=2021-07-13T00:51:48.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:47.865Z InvocationID=46a21bb6-c0ca-471e-94a3-6f20503468ce ResponseDesc=OK 2021-07-13T00:51:48.876Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dea97247-3085-4d8f-8db7-d38048651c26 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:48.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:48.876Z InvocationID=2138cb4f-db7b-4568-a225-e835c325430e 2021-07-13T00:51:49.057Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dea97247-3085-4d8f-8db7-d38048651c26 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:57.226Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a62fc256-ba25-4d5c-869a-273f2ccd6cae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:57.226Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:57.226Z InvocationID=5f3e939d-ec3a-4a6d-8315-fa345b84ca23 2021-07-13T00:51:57.359Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a62fc256-ba25-4d5c-869a-273f2ccd6cae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:57.440Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ee2988b7-6805-402e-bc2d-c1e78917a2fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:57.440Z InvocationID=68d2e8f7-6496-46e8-8ae3-aa7d44e5bf51 2021-07-13T00:51:57.557Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a62fc256-ba25-4d5c-869a-273f2ccd6cae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=331 EndTimestamp=2021-07-13T00:51:57.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:57.226Z InvocationID=7e6ef349-4b3c-45e1-b673-3d419b1057d9 ResponseDesc=OK 2021-07-13T00:51:57.718Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ee2988b7-6805-402e-bc2d-c1e78917a2fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:58.113Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ee2988b7-6805-402e-bc2d-c1e78917a2fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=673 EndTimestamp=2021-07-13T00:51:58.113Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:57.440Z InvocationID=95f39a36-e43a-4d01-b1f4-0757323beb73 ResponseDesc=OK 2021-07-13T00:51:58.529Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e61d3a02-998e-4efe-a16f-11fae54defc6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:58.529Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:58.529Z InvocationID=3b8dfc20-529a-4e33-8ad8-06338a3b39a5 2021-07-13T00:51:58.657Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e61d3a02-998e-4efe-a16f-11fae54defc6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:51:59.060Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e61d3a02-998e-4efe-a16f-11fae54defc6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=531 EndTimestamp=2021-07-13T00:51:59.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:58.529Z InvocationID=030dcda1-5ae6-49e5-863c-f2ca5aaa1106 ResponseDesc=OK 2021-07-13T00:51:59.518Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=dea97247-3085-4d8f-8db7-d38048651c26 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:51:59.657Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=dea97247-3085-4d8f-8db7-d38048651c26 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=10781 EndTimestamp=2021-07-13T00:51:59.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:48.876Z InvocationID=3a870bbc-abf2-4a43-88ee-ce9bdc91f7a5 ResponseDesc=Internal Server Error 2021-07-13T00:51:59.661Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=56e8a1d3-905a-4d5a-8cdf-8a0de0b35b09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:51:59.661Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:59.661Z InvocationID=ce7fe735-9215-4a3f-b445-d6d5de41fbd2 2021-07-13T00:51:59.859Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=56e8a1d3-905a-4d5a-8cdf-8a0de0b35b09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:00.163Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5d0aafaf-9635-40e3-855c-ae45b675dab9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:00.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:00.163Z InvocationID=207f1557-b910-420b-9750-a692565020a9 2021-07-13T00:52:00.318Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=56e8a1d3-905a-4d5a-8cdf-8a0de0b35b09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=657 EndTimestamp=2021-07-13T00:52:00.318Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:51:59.661Z InvocationID=0a7cbc1b-6703-40cf-9ac1-22f2169eaef5 ResponseDesc=OK 2021-07-13T00:52:00.412Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5d0aafaf-9635-40e3-855c-ae45b675dab9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:00.659Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5d0aafaf-9635-40e3-855c-ae45b675dab9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:52:00.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:00.163Z InvocationID=61e65132-2be8-44f7-a5a1-eda579fc12b4 ResponseDesc=OK 2021-07-13T00:52:01.862Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=36b4086d-d2b1-4b17-8261-c860acae6c3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:01.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:01.862Z InvocationID=a74e7ec4-cf8a-441a-a944-62a79af12ee2 2021-07-13T00:52:01.957Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=36b4086d-d2b1-4b17-8261-c860acae6c3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:02.357Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=36b4086d-d2b1-4b17-8261-c860acae6c3e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:52:02.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:01.862Z InvocationID=c20400c9-1ddc-4078-9790-525aa6e4cf19 ResponseDesc=OK 2021-07-13T00:52:03.663Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f53c10aa-6f34-4134-bed0-0de3b4773545 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:03.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:03.663Z InvocationID=9efdbccc-70d0-482e-9da0-6e0390a88252 2021-07-13T00:52:03.860Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f53c10aa-6f34-4134-bed0-0de3b4773545 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:04.128Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f53c10aa-6f34-4134-bed0-0de3b4773545 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=465 EndTimestamp=2021-07-13T00:52:04.128Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:03.663Z InvocationID=d4491efd-e1d8-4243-bfcb-129d35d6ee58 ResponseDesc=OK 2021-07-13T00:52:06.171Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=382efeb1-59b2-4a38-b32a-86cd51f41fb6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:06.171Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:06.171Z InvocationID=97eaf303-7f73-470a-8af7-41698df96e45 2021-07-13T00:52:06.516Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=382efeb1-59b2-4a38-b32a-86cd51f41fb6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:06.761Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=382efeb1-59b2-4a38-b32a-86cd51f41fb6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=590 EndTimestamp=2021-07-13T00:52:06.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:06.171Z InvocationID=bfcc9241-92bf-4259-81ad-889f477a4dcb ResponseDesc=OK 2021-07-13T00:52:07.441Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b7e522d9-c09a-4ca2-96d4-2dc7611e7827 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:07.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:07.441Z InvocationID=549871cd-0d27-4013-b218-e61c82590ec4 2021-07-13T00:52:07.557Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b7e522d9-c09a-4ca2-96d4-2dc7611e7827 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:08.057Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b7e522d9-c09a-4ca2-96d4-2dc7611e7827 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=616 EndTimestamp=2021-07-13T00:52:08.057Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:07.441Z InvocationID=9afde12b-7f04-4247-aa01-981801a06e64 ResponseDesc=OK 2021-07-13T00:52:08.873Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cb92bed5-27c2-41fe-b5f4-488e8d28d54d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:08.873Z InvocationID=ecc9f82e-0dc6-4ec9-8380-44ffd6443e77 2021-07-13T00:52:08.959Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cb92bed5-27c2-41fe-b5f4-488e8d28d54d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:09.164Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c31b639c-f863-4253-881e-716fd5eec710 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:09.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:09.164Z InvocationID=8457f0c4-9576-4c77-9706-e424d972540b 2021-07-13T00:52:09.312Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cb92bed5-27c2-41fe-b5f4-488e8d28d54d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:52:09.312Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:08.873Z InvocationID=33cfef9c-8e5b-4d98-9f03-908deafc4d9d ResponseDesc=OK 2021-07-13T00:52:09.416Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c31b639c-f863-4253-881e-716fd5eec710 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:09.660Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c31b639c-f863-4253-881e-716fd5eec710 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:52:09.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:09.164Z InvocationID=1d2ea907-bf1f-4b30-9b85-2c1760c9d457 ResponseDesc=OK 2021-07-13T00:52:11.861Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ecc60331-4f18-408b-a939-2a457c1147bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:11.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:11.861Z InvocationID=bbad9810-d1c8-4638-ac84-b07f9b125a0a 2021-07-13T00:52:11.956Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ecc60331-4f18-408b-a939-2a457c1147bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:12.269Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ecc60331-4f18-408b-a939-2a457c1147bb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=408 EndTimestamp=2021-07-13T00:52:12.269Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:11.861Z InvocationID=829541ec-4588-4b04-9064-d0efe12cd346 ResponseDesc=OK 2021-07-13T00:52:15.168Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2f06615f-1a23-40eb-b8c5-6f956ccdd24d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:15.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:15.168Z InvocationID=43d862c6-b64f-43f4-9ab6-a3828cb2cedf 2021-07-13T00:52:15.459Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2f06615f-1a23-40eb-b8c5-6f956ccdd24d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:15.839Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2f06615f-1a23-40eb-b8c5-6f956ccdd24d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=671 EndTimestamp=2021-07-13T00:52:15.839Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:15.168Z InvocationID=8037def7-e9db-4a0d-af36-fe0dfd7acac1 ResponseDesc=OK 2021-07-13T00:52:17.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e605022-2786-485a-b439-79c81c3c400d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:17.439Z InvocationID=2c77aee8-b8b1-4901-a5ce-d7661d67f5f9 2021-07-13T00:52:17.612Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e605022-2786-485a-b439-79c81c3c400d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:17.860Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e605022-2786-485a-b439-79c81c3c400d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=421 EndTimestamp=2021-07-13T00:52:17.860Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:17.439Z InvocationID=4d8aa85d-0c74-4bf6-af4e-1657fee19958 ResponseDesc=OK 2021-07-13T00:52:18.271Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=606bed0b-7565-4416-b6ee-867534d3414f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:18.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:18.271Z InvocationID=b51fc349-3c77-4a60-9090-aa5287eb2190 2021-07-13T00:52:18.457Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=606bed0b-7565-4416-b6ee-867534d3414f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:18.857Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=606bed0b-7565-4416-b6ee-867534d3414f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=586 EndTimestamp=2021-07-13T00:52:18.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:18.271Z InvocationID=4120ed9b-0835-418f-a9ad-948b2ab6d788 ResponseDesc=OK 2021-07-13T00:52:18.872Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=496e5ceb-10c8-4609-ab07-30b4b0d2bb9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:18.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:18.872Z InvocationID=0dc142fa-8e4a-413c-9c0d-297ae2aca59e 2021-07-13T00:52:19.059Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=496e5ceb-10c8-4609-ab07-30b4b0d2bb9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:19.312Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=496e5ceb-10c8-4609-ab07-30b4b0d2bb9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=440 EndTimestamp=2021-07-13T00:52:19.312Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:18.872Z InvocationID=c3db85f6-a6ea-4d92-879f-974ec8ea7272 ResponseDesc=OK 2021-07-13T00:52:20.967Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7f0c59be-23cf-4670-b526-2bbd879460c6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:20.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:20.967Z InvocationID=35482e52-9504-4a98-a295-751f1b501e74 2021-07-13T00:52:24.111Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7f0c59be-23cf-4670-b526-2bbd879460c6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:24.359Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7f0c59be-23cf-4670-b526-2bbd879460c6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3392 EndTimestamp=2021-07-13T00:52:24.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:20.967Z InvocationID=e6c5d536-09b2-429f-8ddf-430c6da282da ResponseDesc=OK 2021-07-13T00:52:25.622Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ffbf9c69-7646-4197-ae5b-0459be98866d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:25.622Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:25.622Z InvocationID=a24aa123-53c9-471d-9423-4be162b07e70 2021-07-13T00:52:25.757Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ffbf9c69-7646-4197-ae5b-0459be98866d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:26.557Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ffbf9c69-7646-4197-ae5b-0459be98866d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=935 EndTimestamp=2021-07-13T00:52:26.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:25.622Z InvocationID=47f2933b-3ac1-4dae-8c8e-b944e69a5f18 ResponseDesc=OK 2021-07-13T00:52:27.320Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=076618bb-6401-4560-be71-33ecdc0c3e1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:27.320Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:27.320Z InvocationID=5eed60e0-4cbd-48cf-95ba-70447efe33a0 2021-07-13T00:52:27.443Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8bde40ae-39ec-4499-8956-28ce28a8d7b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:27.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:27.443Z InvocationID=ea1dd715-8e36-46a3-a15c-259e23612455 2021-07-13T00:52:27.463Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=076618bb-6401-4560-be71-33ecdc0c3e1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:27.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8bde40ae-39ec-4499-8956-28ce28a8d7b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:27.860Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=076618bb-6401-4560-be71-33ecdc0c3e1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=540 EndTimestamp=2021-07-13T00:52:27.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:27.320Z InvocationID=b7e79a42-ba0f-4979-9ea0-e9141610c504 ResponseDesc=OK 2021-07-13T00:52:27.936Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8bde40ae-39ec-4499-8956-28ce28a8d7b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=493 EndTimestamp=2021-07-13T00:52:27.936Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:27.443Z InvocationID=012820e0-0f8d-48bf-b5c1-c28b32406e3d ResponseDesc=OK 2021-07-13T00:52:28.873Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5ffff18e-9ffa-4595-bbcc-47fa4ba0ef2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:28.873Z InvocationID=ba47c4fa-3aa7-4491-a6b5-91e21eef7e2d 2021-07-13T00:52:29.057Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5ffff18e-9ffa-4595-bbcc-47fa4ba0ef2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:29.461Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5ffff18e-9ffa-4595-bbcc-47fa4ba0ef2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=587 EndTimestamp=2021-07-13T00:52:29.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:28.873Z InvocationID=ec643b48-e9b9-4e7a-9bcf-751b92ec8646 ResponseDesc=OK 2021-07-13T00:52:29.917Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=153ce43b-149f-41b4-979b-1549cbd2b9f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:29.917Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:29.917Z InvocationID=f752040e-e3c6-446b-97ac-3792e919e8cb 2021-07-13T00:52:30.059Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=153ce43b-149f-41b4-979b-1549cbd2b9f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:30.619Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=153ce43b-149f-41b4-979b-1549cbd2b9f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=701 EndTimestamp=2021-07-13T00:52:30.618Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:29.917Z InvocationID=18a9f68f-a687-4474-bdd5-13e681210473 ResponseDesc=OK 2021-07-13T00:52:33.020Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c8cb0cfa-ca9d-45bc-b9c2-21fc2f6800a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:33.020Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:33.020Z InvocationID=119f4feb-95f5-4910-926d-097bfb68457e 2021-07-13T00:52:33.214Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c8cb0cfa-ca9d-45bc-b9c2-21fc2f6800a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:33.459Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c8cb0cfa-ca9d-45bc-b9c2-21fc2f6800a5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:52:33.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:33.020Z InvocationID=8af6917f-df69-4ca0-aca3-2a5526513dc1 ResponseDesc=OK 2021-07-13T00:52:35.776Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dd943b2b-1e33-4b9e-b17a-78997cdcb797 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:35.776Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:35.776Z InvocationID=9f5853cd-7a7b-4a72-926a-6bbdc7e35186 2021-07-13T00:52:35.956Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dd943b2b-1e33-4b9e-b17a-78997cdcb797 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:36.357Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dd943b2b-1e33-4b9e-b17a-78997cdcb797 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=581 EndTimestamp=2021-07-13T00:52:36.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:35.776Z InvocationID=40c7113b-a0c3-4ee0-9e8c-0ff151a050ea ResponseDesc=OK 2021-07-13T00:52:37.439Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=82713729-52a0-4ddd-b24b-df9317465491 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:37.439Z InvocationID=f3f4a020-68c7-4b04-9a19-634190231f04 2021-07-13T00:52:37.559Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=82713729-52a0-4ddd-b24b-df9317465491 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:37.812Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=82713729-52a0-4ddd-b24b-df9317465491 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=373 EndTimestamp=2021-07-13T00:52:37.812Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:37.439Z InvocationID=43235177-d5da-408c-87be-c26e00351684 ResponseDesc=OK 2021-07-13T00:52:38.463Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b95c003f-868b-460d-9140-62f05d0dc5b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:38.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:38.463Z InvocationID=63f8bc0a-0fb6-44ff-8d50-477d1c6c04d2 2021-07-13T00:52:38.873Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3b619125-0c93-4374-a64c-ad26de531588 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:38.873Z InvocationID=a624787e-9cf6-49f2-a71c-2a75acf01e1b 2021-07-13T00:52:39.161Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3b619125-0c93-4374-a64c-ad26de531588 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:39.625Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b95c003f-868b-460d-9140-62f05d0dc5b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:39.872Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3b619125-0c93-4374-a64c-ad26de531588 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=999 EndTimestamp=2021-07-13T00:52:39.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:38.873Z InvocationID=64228bba-025d-4342-b7f8-b864ba9948be ResponseDesc=OK 2021-07-13T00:52:40.168Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b95c003f-868b-460d-9140-62f05d0dc5b8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1705 EndTimestamp=2021-07-13T00:52:40.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:38.463Z InvocationID=f36b39c9-3398-48f0-b158-cc34776c8433 ResponseDesc=OK 2021-07-13T00:52:41.662Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aeda4c55-44b9-4c7e-b805-247a2cf29e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:41.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:41.662Z InvocationID=f56a8dea-a06a-4a43-bacd-03050a309edf 2021-07-13T00:52:41.761Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aeda4c55-44b9-4c7e-b805-247a2cf29e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:42.063Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aeda4c55-44b9-4c7e-b805-247a2cf29e95 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=401 EndTimestamp=2021-07-13T00:52:42.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:41.662Z InvocationID=1763f0eb-019f-4077-ab6f-dab60863d9d3 ResponseDesc=OK 2021-07-13T00:52:44.969Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=96cd19b1-1015-440b-b865-7ed38987baaa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:44.969Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:44.969Z InvocationID=7a9f778a-7fbf-4cf4-b1b8-197110d81413 2021-07-13T00:52:45.067Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=96cd19b1-1015-440b-b865-7ed38987baaa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:45.261Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=96cd19b1-1015-440b-b865-7ed38987baaa InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=291 EndTimestamp=2021-07-13T00:52:45.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:44.969Z InvocationID=35e8e4c9-ace2-4747-a8f7-475b14493a9d ResponseDesc=OK 2021-07-13T00:52:47.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d6ce7e69-a864-4b00-bc9f-0ec081eb737d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:47.439Z InvocationID=b9af7eb3-d663-499e-a942-9c26242fa43b 2021-07-13T00:52:47.468Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d6ce7e69-a864-4b00-bc9f-0ec081eb737d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:47.663Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d6ce7e69-a864-4b00-bc9f-0ec081eb737d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=224 EndTimestamp=2021-07-13T00:52:47.663Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:47.439Z InvocationID=2d1c350c-b142-419f-b104-69e02580d3ca ResponseDesc=OK 2021-07-13T00:52:47.886Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=84a96b8a-12a5-4263-86d1-971f0122ec09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:47.886Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:47.886Z InvocationID=3735c7ba-fdd2-46b8-83de-afe4d32b859a 2021-07-13T00:52:48.059Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=84a96b8a-12a5-4263-86d1-971f0122ec09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:48.175Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=84a96b8a-12a5-4263-86d1-971f0122ec09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=288 EndTimestamp=2021-07-13T00:52:48.174Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:47.886Z InvocationID=54c7cb11-c532-42dd-822b-2a340ea3f298 ResponseDesc=OK 2021-07-13T00:52:48.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7bd53589-60ee-41d5-8d07-b680d6d7b877 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:48.873Z InvocationID=b3bad313-3ebf-4a8b-9409-b8b03b2ea8e6 2021-07-13T00:52:48.965Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7bd53589-60ee-41d5-8d07-b680d6d7b877 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:49.060Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7bd53589-60ee-41d5-8d07-b680d6d7b877 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=186 EndTimestamp=2021-07-13T00:52:49.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:48.873Z InvocationID=081faeab-a2b5-4671-ae98-61c8a0a52e97 ResponseDesc=OK 2021-07-13T00:52:51.169Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a8c53dbd-33ce-4f47-bdfc-e1e7d175bea7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:51.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:51.168Z InvocationID=75cbc093-882a-4103-a25e-03698c930280 2021-07-13T00:52:51.356Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a8c53dbd-33ce-4f47-bdfc-e1e7d175bea7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:51.564Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a8c53dbd-33ce-4f47-bdfc-e1e7d175bea7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=396 EndTimestamp=2021-07-13T00:52:51.564Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:51.168Z InvocationID=0225df36-eae8-4296-b823-6062401d4853 ResponseDesc=OK 2021-07-13T00:52:53.870Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=219d4309-2f28-4cf3-88ac-7668c41df579 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:53.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:53.870Z InvocationID=f8bb8369-d98f-4ccb-bde6-9fb6eb66d361 2021-07-13T00:52:54.059Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=219d4309-2f28-4cf3-88ac-7668c41df579 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:54.216Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=219d4309-2f28-4cf3-88ac-7668c41df579 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=346 EndTimestamp=2021-07-13T00:52:54.216Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:53.870Z InvocationID=eb83a5b7-717b-4647-ad10-98cc44b19822 ResponseDesc=OK 2021-07-13T00:52:56.759Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=52868a74-f55d-401e-aaa2-8274b2b3a978 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:56.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:56.759Z InvocationID=109a24f5-31ce-427b-85b5-2198490146db 2021-07-13T00:52:57.443Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0c1fe6ca-4bb5-43b6-aabc-43958b364d62 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:57.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:57.443Z InvocationID=73ba2f02-9e6e-4a7a-883b-ce67331260e2 2021-07-13T00:52:57.559Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0c1fe6ca-4bb5-43b6-aabc-43958b364d62 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:57.769Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=52868a74-f55d-401e-aaa2-8274b2b3a978 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:57.867Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0c1fe6ca-4bb5-43b6-aabc-43958b364d62 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=424 EndTimestamp=2021-07-13T00:52:57.867Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:57.443Z InvocationID=1aa5ba98-a86a-4538-89a5-9cb2217fbd8f ResponseDesc=OK 2021-07-13T00:52:58.157Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=52868a74-f55d-401e-aaa2-8274b2b3a978 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1398 EndTimestamp=2021-07-13T00:52:58.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:56.759Z InvocationID=5d5ca974-3621-402b-b970-0c1fab4a1bf2 ResponseDesc=OK 2021-07-13T00:52:58.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6d23152e-b19c-46ba-a3b4-810681bc2b00 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:58.874Z InvocationID=3521aeb0-b816-497c-8cec-ede3b7121826 2021-07-13T00:52:58.965Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6d23152e-b19c-46ba-a3b4-810681bc2b00 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:59.327Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6d23152e-b19c-46ba-a3b4-810681bc2b00 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=453 EndTimestamp=2021-07-13T00:52:59.327Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:58.874Z InvocationID=27b63ced-ee12-4651-a814-cb50819c1763 ResponseDesc=OK 2021-07-13T00:52:59.579Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4e943055-78ba-4c75-b390-6a0fe686ec1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:52:59.579Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:59.579Z InvocationID=d576f126-910b-4bc7-96db-c6dad388cd2d 2021-07-13T00:52:59.666Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4e943055-78ba-4c75-b390-6a0fe686ec1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:52:59.759Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4e943055-78ba-4c75-b390-6a0fe686ec1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=180 EndTimestamp=2021-07-13T00:52:59.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:52:59.579Z InvocationID=8429285d-4133-4578-91f0-7cc0bdc2cccc ResponseDesc=OK 2021-07-13T00:53:02.977Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=17a50cf4-19b4-41d6-b778-e8f854102f24 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:02.977Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:02.977Z InvocationID=a335e858-067b-487b-859c-b47956bb1ff7 2021-07-13T00:53:03.256Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=17a50cf4-19b4-41d6-b778-e8f854102f24 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:03.657Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=17a50cf4-19b4-41d6-b778-e8f854102f24 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=680 EndTimestamp=2021-07-13T00:53:03.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:02.977Z InvocationID=382dacbe-e8ef-42e7-9711-be7957e44d22 ResponseDesc=OK 2021-07-13T00:53:05.772Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=75c1a177-b4c3-4dac-aa33-d98963477608 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:05.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:05.772Z InvocationID=b72e5944-cc01-40d3-92c9-d2a7357176f8 2021-07-13T00:53:05.959Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=75c1a177-b4c3-4dac-aa33-d98963477608 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:06.315Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=75c1a177-b4c3-4dac-aa33-d98963477608 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=543 EndTimestamp=2021-07-13T00:53:06.315Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:05.772Z InvocationID=630b86da-8375-4ac0-bc41-dbb783c52d9d ResponseDesc=OK 2021-07-13T00:53:07.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5a4b6ab8-168a-4d56-a899-531a90ad1aa2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:07.439Z InvocationID=39f96297-fb18-4951-9a27-2926796b99da 2021-07-13T00:53:07.511Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5a4b6ab8-168a-4d56-a899-531a90ad1aa2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:07.670Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5a4b6ab8-168a-4d56-a899-531a90ad1aa2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=231 EndTimestamp=2021-07-13T00:53:07.670Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:07.439Z InvocationID=c519b6de-5f62-4e6a-b785-6798e5193819 ResponseDesc=OK 2021-07-13T00:53:08.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=15fe4df2-a543-42ec-9e46-e56b34b1bb1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:08.873Z InvocationID=86e8c175-c149-4961-889e-5b2b9e6eb50e 2021-07-13T00:53:09.059Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=15fe4df2-a543-42ec-9e46-e56b34b1bb1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:09.066Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6e4fe686-3dd3-46bd-a5ea-adc4e138ab8e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:09.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:09.066Z InvocationID=f64615e1-385e-4b29-9264-a1977f8ee657 2021-07-13T00:53:09.159Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6e4fe686-3dd3-46bd-a5ea-adc4e138ab8e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:09.858Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6e4fe686-3dd3-46bd-a5ea-adc4e138ab8e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=792 EndTimestamp=2021-07-13T00:53:09.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:09.066Z InvocationID=478131fd-6f30-4c5f-8edb-7d2ad5298cee ResponseDesc=OK 2021-07-13T00:53:10.123Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=15fe4df2-a543-42ec-9e46-e56b34b1bb1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1250 EndTimestamp=2021-07-13T00:53:10.123Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:08.873Z InvocationID=b41e16b4-473f-4533-b21b-34de3388a7b2 ResponseDesc=OK 2021-07-13T00:53:11.864Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=de72449c-c463-4bb1-b571-540aa98f25b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:11.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:11.864Z InvocationID=9131fe70-51c9-492d-8100-edd1b5f546c5 2021-07-13T00:53:13.723Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=de72449c-c463-4bb1-b571-540aa98f25b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:13.960Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=de72449c-c463-4bb1-b571-540aa98f25b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2096 EndTimestamp=2021-07-13T00:53:13.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:11.864Z InvocationID=aac08a51-24d2-4c92-a4a1-abbafad9413a ResponseDesc=OK 2021-07-13T00:53:15.467Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a9efdecb-2e92-4e4e-9a88-5739f3baae91 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:15.467Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:15.467Z InvocationID=7f81ca04-1987-4298-a45e-43b60195d257 2021-07-13T00:53:15.657Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a9efdecb-2e92-4e4e-9a88-5739f3baae91 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:16.057Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a9efdecb-2e92-4e4e-9a88-5739f3baae91 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=590 EndTimestamp=2021-07-13T00:53:16.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:15.467Z InvocationID=af233822-a745-40aa-a109-f18251abeda2 ResponseDesc=OK 2021-07-13T00:53:17.446Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=19144686-ea3a-40de-883a-2ac04b45f671 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:17.445Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:17.445Z InvocationID=b080c8ca-a092-4d59-bbe3-bf8529429f56 2021-07-13T00:53:17.560Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=19144686-ea3a-40de-883a-2ac04b45f671 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:17.764Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=19144686-ea3a-40de-883a-2ac04b45f671 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=319 EndTimestamp=2021-07-13T00:53:17.764Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:17.445Z InvocationID=f1b1c655-8429-4da6-88c4-7d765be754f6 ResponseDesc=OK 2021-07-13T00:53:17.968Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b59ce207-3c17-4042-84e1-fdd751e435ed InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:17.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:17.968Z InvocationID=978fc292-bd53-44b8-830c-24b7d765c847 2021-07-13T00:53:18.322Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b59ce207-3c17-4042-84e1-fdd751e435ed InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:18.560Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b59ce207-3c17-4042-84e1-fdd751e435ed InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=591 EndTimestamp=2021-07-13T00:53:18.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:17.968Z InvocationID=b5074495-2d4c-47c8-9d7a-057ceb072685 ResponseDesc=OK 2021-07-13T00:53:18.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cc1e9bfb-cefa-465e-9d52-4df17264341b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:18.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:18.872Z InvocationID=2eb7dd28-5677-4463-9820-9ac0c14e9703 2021-07-13T00:53:19.057Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cc1e9bfb-cefa-465e-9d52-4df17264341b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:19.464Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cc1e9bfb-cefa-465e-9d52-4df17264341b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=592 EndTimestamp=2021-07-13T00:53:19.464Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:18.872Z InvocationID=e8017fb4-1b2a-4bb4-bd58-22f47c3ae0df ResponseDesc=OK 2021-07-13T00:53:20.859Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=82127498-7137-4b99-b4bb-c21523c1f90e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:20.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:20.859Z InvocationID=57492b3e-25c6-4693-b267-e0902f824f6d 2021-07-13T00:53:21.169Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=82127498-7137-4b99-b4bb-c21523c1f90e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:21.417Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=82127498-7137-4b99-b4bb-c21523c1f90e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=558 EndTimestamp=2021-07-13T00:53:21.417Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:20.859Z InvocationID=88a23e32-6f13-46b5-abb8-a09bc1c2dca5 ResponseDesc=OK 2021-07-13T00:53:23.965Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2dc7e34e-9c17-4389-96b9-42259c376b23 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:23.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:23.965Z InvocationID=b0eeef43-8942-4b41-82fc-8c9937b665bc 2021-07-13T00:53:24.814Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2dc7e34e-9c17-4389-96b9-42259c376b23 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:25.164Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2dc7e34e-9c17-4389-96b9-42259c376b23 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1198 EndTimestamp=2021-07-13T00:53:25.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:23.965Z InvocationID=ba56b699-166c-4551-bffe-7b0a9170d9be ResponseDesc=OK 2021-07-13T00:53:27.033Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4cf9f49a-d8a0-48f1-9abb-a1cafc50b827 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:27.033Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:27.033Z InvocationID=436010b8-b4a1-407b-b1a4-2fed22daedcb 2021-07-13T00:53:27.164Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4cf9f49a-d8a0-48f1-9abb-a1cafc50b827 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:27.442Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d22441d0-6b42-4a95-90f8-4828109ab7b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:27.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:27.442Z InvocationID=7a04a762-504a-4c86-8af7-05c213134722 2021-07-13T00:53:27.558Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4cf9f49a-d8a0-48f1-9abb-a1cafc50b827 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=525 EndTimestamp=2021-07-13T00:53:27.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:27.033Z InvocationID=71d064b6-12aa-459b-b198-ea262718421c ResponseDesc=OK 2021-07-13T00:53:27.562Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d22441d0-6b42-4a95-90f8-4828109ab7b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:27.918Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d22441d0-6b42-4a95-90f8-4828109ab7b1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=476 EndTimestamp=2021-07-13T00:53:27.918Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:27.442Z InvocationID=946ff643-4fcd-4f92-9e62-20944609e7fe ResponseDesc=OK 2021-07-13T00:53:28.874Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7b5c8423-4180-4f0b-9e6f-55fb523d71a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:28.874Z InvocationID=6e31830f-1010-4b57-971d-0c495fba720d 2021-07-13T00:53:29.366Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7b5c8423-4180-4f0b-9e6f-55fb523d71a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:29.660Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7b5c8423-4180-4f0b-9e6f-55fb523d71a7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=786 EndTimestamp=2021-07-13T00:53:29.660Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:28.874Z InvocationID=eed84c4e-e85e-47f9-81de-5b6b82f83c77 ResponseDesc=OK 2021-07-13T00:53:29.767Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=44ea1b88-dc5a-4539-9d3f-aa2d70fe6522 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:29.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:29.766Z InvocationID=3065a487-95e5-4e38-991e-1bf51ccdfbe6 2021-07-13T00:53:29.956Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=44ea1b88-dc5a-4539-9d3f-aa2d70fe6522 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:30.957Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=44ea1b88-dc5a-4539-9d3f-aa2d70fe6522 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1191 EndTimestamp=2021-07-13T00:53:30.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:29.766Z InvocationID=1098a128-8a25-4189-9184-b2fb28375651 ResponseDesc=OK 2021-07-13T00:53:32.613Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ee7319eb-c499-463e-8785-c97ef6a2cdf3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:32.613Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:32.613Z InvocationID=3a6996a4-195d-464d-9d59-67e8cc6f4272 2021-07-13T00:53:32.759Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ee7319eb-c499-463e-8785-c97ef6a2cdf3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:33.312Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ee7319eb-c499-463e-8785-c97ef6a2cdf3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=699 EndTimestamp=2021-07-13T00:53:33.312Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:32.613Z InvocationID=af53e115-43f4-4c53-bf71-4b2b907d85e9 ResponseDesc=OK 2021-07-13T00:53:36.420Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1f48198b-bb82-4c1a-a874-4df855fbb876 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:36.420Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:36.420Z InvocationID=fd97357a-5e02-44d4-a810-a332be588627 2021-07-13T00:53:36.616Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1f48198b-bb82-4c1a-a874-4df855fbb876 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:36.764Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1f48198b-bb82-4c1a-a874-4df855fbb876 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=343 EndTimestamp=2021-07-13T00:53:36.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:36.420Z InvocationID=0698d08e-5693-4163-bf55-4ccd5b8bdc4f ResponseDesc=OK 2021-07-13T00:53:37.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3adc0ea9-ee56-4598-b978-e05711e53feb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:37.439Z InvocationID=99a9e8c6-98b4-4f22-9da5-ca23a03632c2 2021-07-13T00:53:37.556Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3adc0ea9-ee56-4598-b978-e05711e53feb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:37.858Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3adc0ea9-ee56-4598-b978-e05711e53feb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=419 EndTimestamp=2021-07-13T00:53:37.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:37.439Z InvocationID=261a8613-4e2a-4911-9732-e839f04603fc ResponseDesc=OK 2021-07-13T00:53:38.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1b253ab0-d063-4849-b502-ee2a6bba7abb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:38.873Z InvocationID=3c04fe5e-0bce-4c15-8478-f6188f4d81f9 2021-07-13T00:53:38.968Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=58f0a847-dc52-407c-b79e-67e047b37590 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:38.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:38.967Z InvocationID=0579e8b2-9aa7-4544-9d43-94370ab45db7 2021-07-13T00:53:39.057Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=58f0a847-dc52-407c-b79e-67e047b37590 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:39.059Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1b253ab0-d063-4849-b502-ee2a6bba7abb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:39.464Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=58f0a847-dc52-407c-b79e-67e047b37590 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=497 EndTimestamp=2021-07-13T00:53:39.464Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:38.967Z InvocationID=bf4ec7c4-b702-455b-bbbc-609279139fea ResponseDesc=OK 2021-07-13T00:53:39.524Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1b253ab0-d063-4849-b502-ee2a6bba7abb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=651 EndTimestamp=2021-07-13T00:53:39.524Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:38.873Z InvocationID=85c69a1c-2bfc-414f-8700-ca86123b2ad4 ResponseDesc=OK 2021-07-13T00:53:41.465Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=16dba2ab-d6f9-4fce-a010-470c52c9aa8e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:41.465Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:41.465Z InvocationID=adce60e1-b2a6-474f-a275-2e292cce1ff5 2021-07-13T00:53:41.657Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=16dba2ab-d6f9-4fce-a010-470c52c9aa8e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:42.057Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=16dba2ab-d6f9-4fce-a010-470c52c9aa8e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=592 EndTimestamp=2021-07-13T00:53:42.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:41.465Z InvocationID=016e5d6c-7ae5-4b8c-907b-b4b17bd91e99 ResponseDesc=OK 2021-07-13T00:53:45.072Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aa0e6fa8-007a-4bc4-8fd5-70c13365ad51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:45.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:45.072Z InvocationID=558a72c4-f0cf-4442-a59b-897414e56eab 2021-07-13T00:53:45.359Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aa0e6fa8-007a-4bc4-8fd5-70c13365ad51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:46.713Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aa0e6fa8-007a-4bc4-8fd5-70c13365ad51 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1641 EndTimestamp=2021-07-13T00:53:46.713Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:45.072Z InvocationID=87686cd8-78a1-469d-8e19-6f9403e2ddaa ResponseDesc=OK 2021-07-13T00:53:47.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fbab5ee0-a100-4201-927d-2c7b37976e8f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:47.439Z InvocationID=72f08327-c76e-4147-b0ad-67b0a3a8de7d 2021-07-13T00:53:47.616Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fbab5ee0-a100-4201-927d-2c7b37976e8f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:47.864Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fbab5ee0-a100-4201-927d-2c7b37976e8f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=425 EndTimestamp=2021-07-13T00:53:47.864Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:47.439Z InvocationID=0e7a8ab1-b09a-4d3d-8642-9dae5be2772f ResponseDesc=OK 2021-07-13T00:53:48.018Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f35c854-dac0-41f5-8042-b8ae32f65910 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:48.018Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:48.018Z InvocationID=5e9b1285-db3a-496b-8468-9c4f72b70516 2021-07-13T00:53:48.063Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f35c854-dac0-41f5-8042-b8ae32f65910 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:48.357Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0f35c854-dac0-41f5-8042-b8ae32f65910 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=339 EndTimestamp=2021-07-13T00:53:48.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:48.018Z InvocationID=7f5d0d85-c96c-42d9-b676-7db506b86a75 ResponseDesc=OK 2021-07-13T00:53:48.874Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fdf35677-8402-4295-ae41-2c2df9dab712 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:48.874Z InvocationID=647bb75f-4216-4efc-b8e6-ea243dd178e9 2021-07-13T00:53:48.959Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fdf35677-8402-4295-ae41-2c2df9dab712 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:49.167Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fdf35677-8402-4295-ae41-2c2df9dab712 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=293 EndTimestamp=2021-07-13T00:53:49.167Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:48.874Z InvocationID=7b044898-7c91-44c9-9e96-fce6d93ff45d ResponseDesc=OK 2021-07-13T00:53:50.863Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=453e2e39-7ee0-4d32-b766-0f71ba855578 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:50.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:50.863Z InvocationID=d94fb6bb-8512-4cb7-a2a8-5ac20cee26d2 2021-07-13T00:53:51.120Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=453e2e39-7ee0-4d32-b766-0f71ba855578 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:51.359Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=453e2e39-7ee0-4d32-b766-0f71ba855578 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:53:51.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:50.863Z InvocationID=8f6ece2c-f2e3-4cf3-a2d8-6b708ed365ac ResponseDesc=OK 2021-07-13T00:53:53.673Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=649548cb-f99c-43cd-8a4a-09876e80412a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:53.673Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:53.673Z InvocationID=8393f26c-fcf0-487a-ba18-c6a4d3889444 2021-07-13T00:53:53.857Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=649548cb-f99c-43cd-8a4a-09876e80412a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:54.257Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=649548cb-f99c-43cd-8a4a-09876e80412a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=584 EndTimestamp=2021-07-13T00:53:54.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:53.673Z InvocationID=6bf8f7f2-bd6f-4660-84cf-16fc27a890da ResponseDesc=OK 2021-07-13T00:53:56.876Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=19be8edc-1851-4eca-8286-4a99fabd537d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:56.875Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:56.875Z InvocationID=471bcc94-9ad6-4a3c-b164-4b9766667c6b 2021-07-13T00:53:57.060Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=19be8edc-1851-4eca-8286-4a99fabd537d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:57.312Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=19be8edc-1851-4eca-8286-4a99fabd537d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=437 EndTimestamp=2021-07-13T00:53:57.312Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:56.875Z InvocationID=df4b2398-d972-443f-bf09-f4f4c0068564 ResponseDesc=OK 2021-07-13T00:53:57.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=07701c38-97a0-4648-88b2-326b73e8a035 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:57.439Z InvocationID=9006c8ab-a1b2-4770-a5e8-4651cb2709b0 2021-07-13T00:53:57.714Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=07701c38-97a0-4648-88b2-326b73e8a035 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:57.959Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=07701c38-97a0-4648-88b2-326b73e8a035 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=520 EndTimestamp=2021-07-13T00:53:57.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:57.439Z InvocationID=72afb866-494b-4db3-b185-74c902a3b6aa ResponseDesc=OK 2021-07-13T00:53:58.878Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=02bbe5a2-97f7-4cb0-91ff-881370f13d43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:58.877Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:58.877Z InvocationID=5774d344-14b3-4a80-b401-fe23e07f3fda 2021-07-13T00:53:59.057Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=02bbe5a2-97f7-4cb0-91ff-881370f13d43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:53:59.563Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=02bbe5a2-97f7-4cb0-91ff-881370f13d43 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=685 EndTimestamp=2021-07-13T00:53:59.562Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:58.877Z InvocationID=f9237e68-c62c-493f-924d-42bd99542fd3 ResponseDesc=OK 2021-07-13T00:53:59.870Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c6ac3c80-8dc6-4266-83c3-7c8056ecf474 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:53:59.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:59.870Z InvocationID=03b886c3-786e-45b7-9412-a584cdcbd7ac 2021-07-13T00:54:00.058Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c6ac3c80-8dc6-4266-83c3-7c8056ecf474 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:00.411Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c6ac3c80-8dc6-4266-83c3-7c8056ecf474 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=541 EndTimestamp=2021-07-13T00:54:00.411Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:53:59.870Z InvocationID=3a1d7f6c-da3f-4dea-be5c-664f2519bd74 ResponseDesc=OK 2021-07-13T00:54:02.964Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31b33448-9047-4c8a-9e09-2313fd72f9ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:02.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:02.964Z InvocationID=abfe3c64-312b-4c8f-9dd8-f13478ddad05 2021-07-13T00:54:03.221Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31b33448-9047-4c8a-9e09-2313fd72f9ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:03.462Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31b33448-9047-4c8a-9e09-2313fd72f9ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=498 EndTimestamp=2021-07-13T00:54:03.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:02.964Z InvocationID=a2a24773-2a3f-42f1-a6b9-0f1f92f675b3 ResponseDesc=OK 2021-07-13T00:54:05.869Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cdc23ea6-6622-454c-8daf-e3019e633c56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:05.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:05.869Z InvocationID=be57e06e-64e3-4533-a835-3eded676c96a 2021-07-13T00:54:06.057Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cdc23ea6-6622-454c-8daf-e3019e633c56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:06.457Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cdc23ea6-6622-454c-8daf-e3019e633c56 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=588 EndTimestamp=2021-07-13T00:54:06.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:05.869Z InvocationID=5e9e48ad-c7c5-436a-9a6a-4eac160b2c7a ResponseDesc=OK 2021-07-13T00:54:07.441Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=943c119b-3cc6-4cde-9a9a-bec55eb0e397 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:07.440Z InvocationID=6679f600-855c-4428-a5c7-615286875464 2021-07-13T00:54:07.561Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=943c119b-3cc6-4cde-9a9a-bec55eb0e397 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:07.811Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=943c119b-3cc6-4cde-9a9a-bec55eb0e397 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=371 EndTimestamp=2021-07-13T00:54:07.811Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:07.440Z InvocationID=7b2cecb9-b04d-42ec-a72e-2791fc2340c2 ResponseDesc=OK 2021-07-13T00:54:08.761Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=99f13eea-7ba3-4496-bb0e-d11b69f8e94b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:08.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:08.761Z InvocationID=9ddcd6f1-2923-45f5-b6b9-49a9cd213853 2021-07-13T00:54:08.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fc27079c-5c94-42fb-8e0f-d4a28a97bcae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:08.873Z InvocationID=5247e71d-c868-4f39-a181-82c71a586826 2021-07-13T00:54:08.966Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fc27079c-5c94-42fb-8e0f-d4a28a97bcae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:09.014Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=99f13eea-7ba3-4496-bb0e-d11b69f8e94b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:09.160Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fc27079c-5c94-42fb-8e0f-d4a28a97bcae InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=287 EndTimestamp=2021-07-13T00:54:09.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:08.873Z InvocationID=bf273764-9c50-4376-b5f9-3e1513f3fe22 ResponseDesc=OK 2021-07-13T00:54:09.658Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=99f13eea-7ba3-4496-bb0e-d11b69f8e94b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=897 EndTimestamp=2021-07-13T00:54:09.658Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:08.761Z InvocationID=10747306-526f-446e-b0b0-2479de5d62ce ResponseDesc=OK 2021-07-13T00:54:12.061Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=955cb9a3-115c-4b5e-a89c-b0ef1bbc08c2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:12.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:12.060Z InvocationID=027bb451-e39d-4969-a43e-be29a197c8ac 2021-07-13T00:54:12.162Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=955cb9a3-115c-4b5e-a89c-b0ef1bbc08c2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:12.622Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=955cb9a3-115c-4b5e-a89c-b0ef1bbc08c2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=562 EndTimestamp=2021-07-13T00:54:12.622Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:12.060Z InvocationID=7c1bcc30-5658-494a-b87b-51eec8e9937f ResponseDesc=OK 2021-07-13T00:54:14.666Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3ca9afa0-9b43-47e4-81bd-ee8655aa231c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:14.666Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:14.666Z InvocationID=8059ab37-d99c-4c7e-b103-b4f362d91401 2021-07-13T00:54:15.712Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3ca9afa0-9b43-47e4-81bd-ee8655aa231c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:15.972Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3ca9afa0-9b43-47e4-81bd-ee8655aa231c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1306 EndTimestamp=2021-07-13T00:54:15.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:14.666Z InvocationID=3cbb30ed-f550-4c04-8230-a66eb4792b18 ResponseDesc=OK 2021-07-13T00:54:17.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8b46f078-de00-4596-a9e0-67e7c57defe7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:17.439Z InvocationID=7509d3a1-b755-4347-9a7d-0ad2e005aec0 2021-07-13T00:54:17.857Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8b46f078-de00-4596-a9e0-67e7c57defe7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:18.258Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8b46f078-de00-4596-a9e0-67e7c57defe7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=819 EndTimestamp=2021-07-13T00:54:18.258Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:17.439Z InvocationID=68eab160-4fcd-4230-816b-d4f48c6e8090 ResponseDesc=OK 2021-07-13T00:54:18.359Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b4f95b39-ff09-4333-b52c-2e766c160fc9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:18.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:18.359Z InvocationID=04b111d3-4d31-4a22-b3ee-d92c2edd8c87 2021-07-13T00:54:18.461Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b4f95b39-ff09-4333-b52c-2e766c160fc9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:18.716Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b4f95b39-ff09-4333-b52c-2e766c160fc9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=357 EndTimestamp=2021-07-13T00:54:18.716Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:18.359Z InvocationID=9877dcd8-d6b5-42dd-af93-ffd69d7a0c87 ResponseDesc=OK 2021-07-13T00:54:18.874Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=28e74392-063f-4f63-86d5-017757d9db3d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:18.874Z InvocationID=2a545e39-a1b2-434d-a085-4736859f4959 2021-07-13T00:54:19.158Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=28e74392-063f-4f63-86d5-017757d9db3d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:19.360Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=28e74392-063f-4f63-86d5-017757d9db3d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:54:19.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:18.874Z InvocationID=4d1c0c1c-2ef4-4808-8f5e-64e462c4d1c3 ResponseDesc=OK 2021-07-13T00:54:20.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=240debab-3873-4167-a18b-fa5980908c97 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:20.874Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:20.874Z InvocationID=1a22826f-c6d2-4e70-913c-67fedfd0d11f 2021-07-13T00:54:21.057Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=240debab-3873-4167-a18b-fa5980908c97 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:21.957Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=240debab-3873-4167-a18b-fa5980908c97 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1083 EndTimestamp=2021-07-13T00:54:21.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:20.874Z InvocationID=a2328281-4a8e-4a31-95ed-4b9a2399d644 ResponseDesc=OK 2021-07-13T00:54:23.964Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=51d8e10d-65f0-46d1-b562-aaa57aae51fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:23.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:23.964Z InvocationID=444f698f-942a-4945-b0cd-aa8729b55d19 2021-07-13T00:54:24.059Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=51d8e10d-65f0-46d1-b562-aaa57aae51fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:24.412Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=51d8e10d-65f0-46d1-b562-aaa57aae51fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=448 EndTimestamp=2021-07-13T00:54:24.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:23.964Z InvocationID=7068bcc7-fd85-4e02-8e4a-8321d9e97959 ResponseDesc=OK 2021-07-13T00:54:27.217Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31795e0e-a2a2-4cff-a4ab-59c3bd949ca3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:27.217Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:27.217Z InvocationID=d632ca27-fdfe-4c1a-b8ed-26486e9b7c3c 2021-07-13T00:54:27.411Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31795e0e-a2a2-4cff-a4ab-59c3bd949ca3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:27.439Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=42ee7635-28e1-4931-bbad-bf88211e2450 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:27.439Z InvocationID=3c3018e2-79cd-40f3-941a-08a5a80aeac3 2021-07-13T00:54:27.557Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=42ee7635-28e1-4931-bbad-bf88211e2450 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:27.659Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31795e0e-a2a2-4cff-a4ab-59c3bd949ca3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=442 EndTimestamp=2021-07-13T00:54:27.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:27.217Z InvocationID=16799f68-eb46-4e81-b3e1-2188e6819749 ResponseDesc=OK 2021-07-13T00:54:27.958Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=42ee7635-28e1-4931-bbad-bf88211e2450 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=519 EndTimestamp=2021-07-13T00:54:27.958Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:27.439Z InvocationID=838a08d5-2663-4b35-80d0-90731707bd81 ResponseDesc=OK 2021-07-13T00:54:28.873Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=84293abe-5772-4da5-b6a6-b0cec8da6ff8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:28.873Z InvocationID=ed3338ef-83c5-42a6-9a53-991c9d019034 2021-07-13T00:54:29.059Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=84293abe-5772-4da5-b6a6-b0cec8da6ff8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:29.428Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=84293abe-5772-4da5-b6a6-b0cec8da6ff8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=554 EndTimestamp=2021-07-13T00:54:29.427Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:28.873Z InvocationID=cb1c65bd-0d77-4ab3-83c5-487a848c4017 ResponseDesc=OK 2021-07-13T00:54:29.967Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3605b3b4-13cf-4de3-8cc3-eb7e0a6d74a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:29.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:29.967Z InvocationID=aef4df40-4abc-46ef-a48d-7581127dc1ee 2021-07-13T00:54:30.326Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3605b3b4-13cf-4de3-8cc3-eb7e0a6d74a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:30.559Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3605b3b4-13cf-4de3-8cc3-eb7e0a6d74a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=592 EndTimestamp=2021-07-13T00:54:30.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:29.967Z InvocationID=10f325a4-7f86-41c0-8852-0ffbf4fa374e ResponseDesc=OK 2021-07-13T00:54:33.072Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=91a652e0-1380-434b-bfc6-1624c387020b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:33.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:33.072Z InvocationID=8d4b2a05-8448-4a1f-ab4e-08709a09c7a0 2021-07-13T00:54:33.356Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=91a652e0-1380-434b-bfc6-1624c387020b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:33.757Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=91a652e0-1380-434b-bfc6-1624c387020b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=685 EndTimestamp=2021-07-13T00:54:33.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:33.072Z InvocationID=6dcad3ae-2137-4452-868b-68381984f5ea ResponseDesc=OK 2021-07-13T00:54:35.670Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ea57d710-1987-4882-a257-36957cda0b3a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:35.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:35.670Z InvocationID=08334325-dfd9-4bb7-9d61-213620047106 2021-07-13T00:54:35.859Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ea57d710-1987-4882-a257-36957cda0b3a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:37.440Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d243f99c-7e77-4e8c-82ca-afd130f00817 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:37.439Z InvocationID=98502fca-bfe2-4445-8615-8d09a281ae32 2021-07-13T00:54:38.876Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1d81e90e-9c2d-4ca4-ac03-7018f97c373b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:38.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:38.875Z InvocationID=7bd87d1a-1b17-49d8-bc76-297891e7d50d 2021-07-13T00:54:39.062Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1d81e90e-9c2d-4ca4-ac03-7018f97c373b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:39.117Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ea57d710-1987-4882-a257-36957cda0b3a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3447 EndTimestamp=2021-07-13T00:54:39.117Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:35.670Z InvocationID=22617f9f-e9e8-419f-aafc-562734968f54 ResponseDesc=OK 2021-07-13T00:54:39.118Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d243f99c-7e77-4e8c-82ca-afd130f00817 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:39.362Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1d81e90e-9c2d-4ca4-ac03-7018f97c373b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=487 EndTimestamp=2021-07-13T00:54:39.362Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:38.875Z InvocationID=dcd76a9d-4727-4696-adb3-cfe3a3e80cc2 ResponseDesc=OK 2021-07-13T00:54:39.457Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d243f99c-7e77-4e8c-82ca-afd130f00817 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2018 EndTimestamp=2021-07-13T00:54:39.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:37.439Z InvocationID=0b9160c1-842f-4818-9ce4-18e0ae713ce9 ResponseDesc=OK 2021-07-13T00:54:39.914Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3ab00917-e1dc-448d-9f6c-deccfba6a63c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:39.914Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:39.914Z InvocationID=e164ad7c-4f2e-4317-add5-0a2bc2e3b177 2021-07-13T00:54:39.995Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3ab00917-e1dc-448d-9f6c-deccfba6a63c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:41.060Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3ab00917-e1dc-448d-9f6c-deccfba6a63c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1146 EndTimestamp=2021-07-13T00:54:41.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:39.914Z InvocationID=e1bad269-8d77-4b3a-acf1-2d71e99b8e1e ResponseDesc=OK 2021-07-13T00:54:42.262Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a2d0f45b-eccc-4d86-9595-c8a1af09ee5b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:42.262Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:42.262Z InvocationID=9ff3094c-4a4a-43f5-95e5-01eff2a760c3 2021-07-13T00:54:43.366Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a2d0f45b-eccc-4d86-9595-c8a1af09ee5b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:43.759Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a2d0f45b-eccc-4d86-9595-c8a1af09ee5b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1497 EndTimestamp=2021-07-13T00:54:43.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:42.262Z InvocationID=2fb406b7-c687-4a96-a345-7bf6ba690bb5 ResponseDesc=OK 2021-07-13T00:54:45.089Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b4eeab66-5f9f-41ce-b25f-1637fef07968 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:45.089Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:45.089Z InvocationID=5fa41d42-d95e-4f2b-b5d6-1b3b3a0cd731 2021-07-13T00:54:45.257Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b4eeab66-5f9f-41ce-b25f-1637fef07968 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:45.757Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b4eeab66-5f9f-41ce-b25f-1637fef07968 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=668 EndTimestamp=2021-07-13T00:54:45.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:45.089Z InvocationID=040eafd5-187c-4bec-9e6f-34cf783bdc49 ResponseDesc=OK 2021-07-13T00:54:47.440Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9e5a548-a659-4b07-9321-af22ec3cd6b6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:47.440Z InvocationID=c429516f-21e5-4993-82ef-b8d3182fa9e2 2021-07-13T00:54:47.559Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b9e5a548-a659-4b07-9321-af22ec3cd6b6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:47.928Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b9e5a548-a659-4b07-9321-af22ec3cd6b6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=488 EndTimestamp=2021-07-13T00:54:47.928Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:47.440Z InvocationID=c549bb09-b036-47c2-b13d-a037ea100d7f ResponseDesc=OK 2021-07-13T00:54:48.875Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2e534d97-a7c3-403b-880d-cf1723571579 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:48.874Z InvocationID=a51ec6bf-3f35-4cf9-a68e-6229fb0e9021 2021-07-13T00:54:48.919Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b5d2e54e-50aa-43b0-a02e-4035fd2cd878 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:48.919Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:48.919Z InvocationID=2cc12606-3a02-485d-a9e3-b27603cc6d58 2021-07-13T00:54:49.061Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b5d2e54e-50aa-43b0-a02e-4035fd2cd878 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:49.114Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2e534d97-a7c3-403b-880d-cf1723571579 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:50.262Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b5d2e54e-50aa-43b0-a02e-4035fd2cd878 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1342 EndTimestamp=2021-07-13T00:54:50.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:48.919Z InvocationID=8397b135-94f8-49ed-a653-eae02569480f ResponseDesc=OK 2021-07-13T00:54:50.565Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2e534d97-a7c3-403b-880d-cf1723571579 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1691 EndTimestamp=2021-07-13T00:54:50.565Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:48.874Z InvocationID=7280cb80-fa31-4382-b57b-1c93cba885be ResponseDesc=OK 2021-07-13T00:54:51.442Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=87f5bfdf-6626-4de2-ac88-4e1235ecd0a4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:51.442Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:51.442Z InvocationID=70013a6a-aee4-41e9-b559-7e82c67d45d5 2021-07-13T00:54:51.560Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=87f5bfdf-6626-4de2-ac88-4e1235ecd0a4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:52.215Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=87f5bfdf-6626-4de2-ac88-4e1235ecd0a4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=773 EndTimestamp=2021-07-13T00:54:52.215Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:51.442Z InvocationID=ce0f2eaf-3a84-45f7-84d1-418cb176c844 ResponseDesc=OK 2021-07-13T00:54:53.871Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5be1d294-16a0-443d-8227-9c8be390401e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:53.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:53.871Z InvocationID=f4e7a1ec-c4db-4520-821d-f9bab7237d5f 2021-07-13T00:54:54.214Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5be1d294-16a0-443d-8227-9c8be390401e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:54.467Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5be1d294-16a0-443d-8227-9c8be390401e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=596 EndTimestamp=2021-07-13T00:54:54.467Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:53.871Z InvocationID=40a80a6d-7905-4b49-89d0-c966be97ee7c ResponseDesc=OK 2021-07-13T00:54:57.421Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=080f1013-d1fc-461e-9677-bfaebb783d5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:57.421Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:57.421Z InvocationID=1678af04-20b1-4f48-bee5-130ee7fc743d 2021-07-13T00:54:57.438Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b726207c-9a9c-4d73-92c1-4912e8cbdcea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:57.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:57.438Z InvocationID=e19aeae5-cb32-4bb4-9be2-cd13de2f37f5 2021-07-13T00:54:57.556Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=080f1013-d1fc-461e-9677-bfaebb783d5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:58.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1a9eba7e-5aae-4155-ba6e-c4afa1bfb060 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:54:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:58.873Z InvocationID=6dfb781c-5992-46c0-a0ca-ae00e40d979a 2021-07-13T00:54:59.658Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1a9eba7e-5aae-4155-ba6e-c4afa1bfb060 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:59.718Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b726207c-9a9c-4d73-92c1-4912e8cbdcea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:54:59.758Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=080f1013-d1fc-461e-9677-bfaebb783d5a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2337 EndTimestamp=2021-07-13T00:54:59.758Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:57.421Z InvocationID=749e4ab0-66b5-479b-ba0b-0834ba543269 ResponseDesc=OK 2021-07-13T00:55:00.671Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fa1c9b1b-7f9e-43b3-b36a-6888f127e499 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:00.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:00.671Z InvocationID=bbc5c075-5615-4f23-8e7c-2a0bf8555505 2021-07-13T00:55:00.759Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1a9eba7e-5aae-4155-ba6e-c4afa1bfb060 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1886 EndTimestamp=2021-07-13T00:55:00.759Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:58.873Z InvocationID=c9078828-60a2-4dd3-9391-379ac003ab44 ResponseDesc=OK 2021-07-13T00:55:00.821Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b726207c-9a9c-4d73-92c1-4912e8cbdcea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3383 EndTimestamp=2021-07-13T00:55:00.821Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:54:57.438Z InvocationID=d8fd46de-ec1f-4a28-9cda-6ad25cf4fd74 ResponseDesc=OK 2021-07-13T00:55:00.856Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fa1c9b1b-7f9e-43b3-b36a-6888f127e499 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:01.257Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fa1c9b1b-7f9e-43b3-b36a-6888f127e499 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=586 EndTimestamp=2021-07-13T00:55:01.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:00.671Z InvocationID=465976e5-a5f3-49b0-ad63-de3efa1895b4 ResponseDesc=OK 2021-07-13T00:55:02.966Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=608c5925-c113-4097-8119-6d7da05a58ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:02.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:02.966Z InvocationID=57a5d3db-2669-438b-a203-2ecd5273a6d1 2021-07-13T00:55:03.060Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=608c5925-c113-4097-8119-6d7da05a58ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:03.914Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=608c5925-c113-4097-8119-6d7da05a58ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=948 EndTimestamp=2021-07-13T00:55:03.914Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:02.966Z InvocationID=c2a25402-c78b-4e2b-86b4-2afb92bb25f1 ResponseDesc=OK 2021-07-13T00:55:06.324Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c1227160-c29e-4154-a5fb-d69b640d5b5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:06.324Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:06.324Z InvocationID=9766d638-9d96-4e84-8e4b-91818cfcf9c0 2021-07-13T00:55:07.122Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c1227160-c29e-4154-a5fb-d69b640d5b5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:07.359Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c1227160-c29e-4154-a5fb-d69b640d5b5c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1035 EndTimestamp=2021-07-13T00:55:07.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:06.324Z InvocationID=7f8ae743-608e-412c-901b-1d23da95c05f ResponseDesc=OK 2021-07-13T00:55:07.439Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce7431a1-5b32-41a6-a922-b78ac9edb978 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:07.439Z InvocationID=01831b86-3c7a-41d4-85a1-59f52c5d612e 2021-07-13T00:55:08.874Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be4ddc69-e02d-43c5-b8ad-20c3b8608a0f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:08.874Z InvocationID=362e6853-b0d9-40bb-89f6-0af573f1ebe7 2021-07-13T00:55:17.464Z [qtp817348612-76] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce7431a1-5b32-41a6-a922-b78ac9edb978 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:55:20.886Z [qtp817348612-74] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be4ddc69-e02d-43c5-b8ad-20c3b8608a0f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:55:22.445Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9b5770ce-a17b-47d3-88df-5dfc66191dbd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:22.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:22.444Z InvocationID=f4d2cfaf-f70f-4490-892d-e30c87999d50 2021-07-13T00:55:23.873Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5965541-db88-4b25-82cf-5ca763feaf71 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:23.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:23.873Z InvocationID=58ed93e6-0a33-4591-9f02-2e7bae3627fe 2021-07-13T00:55:25.360Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5965541-db88-4b25-82cf-5ca763feaf71 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:25.657Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f5965541-db88-4b25-82cf-5ca763feaf71 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1784 EndTimestamp=2021-07-13T00:55:25.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:23.873Z InvocationID=f44c72fb-0176-4abd-9975-36208343faab ResponseDesc=OK 2021-07-13T00:55:26.013Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9b5770ce-a17b-47d3-88df-5dfc66191dbd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:26.021Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=63a57d2f-64f7-4fef-a6d8-50939befe111 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:26.021Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:26.021Z InvocationID=40681521-7e1b-4fe4-982b-779410f544e6 2021-07-13T00:55:26.169Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=63a57d2f-64f7-4fef-a6d8-50939befe111 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:26.418Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9b5770ce-a17b-47d3-88df-5dfc66191dbd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3974 EndTimestamp=2021-07-13T00:55:26.418Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:22.444Z InvocationID=23238550-9d39-436c-80a5-395e2fc45c65 ResponseDesc=OK 2021-07-13T00:55:26.460Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=63a57d2f-64f7-4fef-a6d8-50939befe111 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:55:26.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:26.021Z InvocationID=1f326de0-ee65-49f4-9c4e-6ad2f498f04e ResponseDesc=OK 2021-07-13T00:55:27.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=43f22a33-82b1-4c8e-ae7c-a607b94846c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:27.439Z InvocationID=f4d311bc-0153-401f-bd67-5fbd510ba6af 2021-07-13T00:55:27.472Z [qtp817348612-76] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ce7431a1-5b32-41a6-a922-b78ac9edb978 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:55:27.560Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=ce7431a1-5b32-41a6-a922-b78ac9edb978 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=20121 EndTimestamp=2021-07-13T00:55:27.560Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:07.439Z InvocationID=8383674f-b856-4c96-9bd8-77eefec8d13b ResponseDesc=Internal Server Error 2021-07-13T00:55:28.325Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7be124f0-85a9-4080-baf3-7c6491b709a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:28.325Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:28.325Z InvocationID=54620342-6cd1-4819-bed6-66c233066393 2021-07-13T00:55:28.872Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=db05c046-305b-42bf-a11a-573d15e838af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:28.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:28.872Z InvocationID=4c025542-5940-4c1a-9745-05759329bb40 2021-07-13T00:55:29.057Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=db05c046-305b-42bf-a11a-573d15e838af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:30.958Z [qtp817348612-74] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=be4ddc69-e02d-43c5-b8ad-20c3b8608a0f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:55:31.064Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7be124f0-85a9-4080-baf3-7c6491b709a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:31.118Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=43f22a33-82b1-4c8e-ae7c-a607b94846c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:31.617Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=be4ddc69-e02d-43c5-b8ad-20c3b8608a0f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=22743 EndTimestamp=2021-07-13T00:55:31.617Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:08.874Z InvocationID=ffb8437d-feaf-4321-bfba-a778c8575e40 ResponseDesc=Internal Server Error 2021-07-13T00:55:31.658Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7be124f0-85a9-4080-baf3-7c6491b709a1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3333 EndTimestamp=2021-07-13T00:55:31.658Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:28.325Z InvocationID=d24e84cb-1d1a-4cdb-8bc1-3b4c4378625a ResponseDesc=OK 2021-07-13T00:55:31.659Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=43f22a33-82b1-4c8e-ae7c-a607b94846c1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4220 EndTimestamp=2021-07-13T00:55:31.659Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:27.439Z InvocationID=bbd62da0-eeb1-48eb-bc1e-9281ee437c55 ResponseDesc=OK 2021-07-13T00:55:31.813Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=db05c046-305b-42bf-a11a-573d15e838af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2941 EndTimestamp=2021-07-13T00:55:31.813Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:28.872Z InvocationID=752c6fb1-f92f-42f9-b305-af0f325fb786 ResponseDesc=OK 2021-07-13T00:55:32.307Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=50242859-8edb-4616-88ee-6a93b73449a4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:32.307Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:32.307Z InvocationID=0aaca0ba-0b8e-4077-b063-c7f9d6ac662c 2021-07-13T00:55:34.164Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=50242859-8edb-4616-88ee-6a93b73449a4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:34.360Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=50242859-8edb-4616-88ee-6a93b73449a4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2053 EndTimestamp=2021-07-13T00:55:34.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:32.307Z InvocationID=278ee676-f89d-401c-a19f-c67c0e84634e ResponseDesc=OK 2021-07-13T00:55:35.676Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f2d651da-abe6-4ae8-8207-19ce27578d35 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:35.675Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:35.675Z InvocationID=d615e972-6c53-4e1c-a3a4-0ccfe5db16a7 2021-07-13T00:55:35.857Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f2d651da-abe6-4ae8-8207-19ce27578d35 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:36.064Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f2d651da-abe6-4ae8-8207-19ce27578d35 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=389 EndTimestamp=2021-07-13T00:55:36.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:35.675Z InvocationID=e5b0dbf3-1182-478c-9c26-1536cfe2e17b ResponseDesc=OK 2021-07-13T00:55:37.170Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=48111e1d-be53-49bc-b120-3c1a4ab7f6b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:37.170Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:37.170Z InvocationID=0e8ea402-f240-4de4-b67d-9adfa2deb708 2021-07-13T00:55:37.358Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=48111e1d-be53-49bc-b120-3c1a4ab7f6b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:37.439Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b2b164b8-6029-4c3e-8e72-2e7f80cb2821 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:37.439Z InvocationID=181bc238-6b96-42ae-b52a-49f812717a38 2021-07-13T00:55:37.463Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b2b164b8-6029-4c3e-8e72-2e7f80cb2821 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:37.564Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=48111e1d-be53-49bc-b120-3c1a4ab7f6b7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=394 EndTimestamp=2021-07-13T00:55:37.564Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:37.170Z InvocationID=a2821b28-c778-4a18-8061-34422a7a4180 ResponseDesc=OK 2021-07-13T00:55:37.567Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b2b164b8-6029-4c3e-8e72-2e7f80cb2821 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=128 EndTimestamp=2021-07-13T00:55:37.567Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:37.439Z InvocationID=26a32b65-c5eb-4b22-86b9-0c3a9c329814 ResponseDesc=OK 2021-07-13T00:55:38.873Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f953b7ec-7e1c-42ee-9786-c6383f29f371 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:38.873Z InvocationID=75c2cd89-9d11-4742-b8ea-97de53b9a399 2021-07-13T00:55:38.956Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f953b7ec-7e1c-42ee-9786-c6383f29f371 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:39.461Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8a6c3c55-63c0-46ea-b116-25a9d2913d99 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:39.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:39.461Z InvocationID=70a0e8ca-c9ab-48a5-826e-cfd68d36ce52 2021-07-13T00:55:39.471Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8a6c3c55-63c0-46ea-b116-25a9d2913d99 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:39.757Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8a6c3c55-63c0-46ea-b116-25a9d2913d99 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=296 EndTimestamp=2021-07-13T00:55:39.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:39.461Z InvocationID=a9f32e24-c97d-4a90-82e3-eb3648c93b9f ResponseDesc=OK 2021-07-13T00:55:40.751Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f953b7ec-7e1c-42ee-9786-c6383f29f371 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1877 EndTimestamp=2021-07-13T00:55:40.750Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:38.873Z InvocationID=da597fad-590c-4e6b-97f7-5219a3bf7035 ResponseDesc=OK 2021-07-13T00:55:41.622Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fad0bdbd-c71e-4321-98c9-41fe9014b8f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:41.621Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:41.621Z InvocationID=fc168c88-ff28-43f6-8c5d-f3684c06c714 2021-07-13T00:55:41.723Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fad0bdbd-c71e-4321-98c9-41fe9014b8f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:42.360Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fad0bdbd-c71e-4321-98c9-41fe9014b8f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=739 EndTimestamp=2021-07-13T00:55:42.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:41.621Z InvocationID=f69a6a98-f45c-4f92-9bb3-8a17af1cd808 ResponseDesc=OK 2021-07-13T00:55:43.464Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8270ce3e-09eb-4115-be97-f76c70434cef InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:43.464Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:43.464Z InvocationID=99c048e0-f1d8-4341-927d-92af3c52f597 2021-07-13T00:55:43.558Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8270ce3e-09eb-4115-be97-f76c70434cef InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:43.768Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8270ce3e-09eb-4115-be97-f76c70434cef InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=304 EndTimestamp=2021-07-13T00:55:43.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:43.464Z InvocationID=cf375266-d3e2-4747-8ee1-b8a12086c607 ResponseDesc=OK 2021-07-13T00:55:44.978Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ba6d01ef-7348-479c-9a7b-0a7e96c4f396 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:44.977Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:44.977Z InvocationID=fdf9d27e-2fc0-4525-a900-53f6a5478f2d 2021-07-13T00:55:45.160Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ba6d01ef-7348-479c-9a7b-0a7e96c4f396 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:45.740Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ba6d01ef-7348-479c-9a7b-0a7e96c4f396 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=762 EndTimestamp=2021-07-13T00:55:45.739Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:44.977Z InvocationID=81c08e17-9465-46e7-afb4-46fff78ef131 ResponseDesc=OK 2021-07-13T00:55:46.720Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c39e406e-250c-4c9e-abe5-b01270ce148f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:46.720Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:46.720Z InvocationID=19c6b000-f57e-4c63-b694-36b24c3ae3d0 2021-07-13T00:55:46.918Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c39e406e-250c-4c9e-abe5-b01270ce148f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:47.159Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c39e406e-250c-4c9e-abe5-b01270ce148f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:55:47.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:46.720Z InvocationID=945c9039-e43c-4f51-9e55-e58c3ca74da6 ResponseDesc=OK 2021-07-13T00:55:47.440Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5ff83d43-a411-4f87-958d-3640e14eaaba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:47.440Z InvocationID=c6e0cccd-6656-430e-9140-f65a54b19e4e 2021-07-13T00:55:47.662Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5ff83d43-a411-4f87-958d-3640e14eaaba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:47.957Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5ff83d43-a411-4f87-958d-3640e14eaaba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=517 EndTimestamp=2021-07-13T00:55:47.957Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:47.440Z InvocationID=c02e185f-8ec0-43f2-87f6-043dcf43a03d ResponseDesc=OK 2021-07-13T00:55:48.373Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2e9dd290-e116-4fb4-b66b-2f05d52ea5b5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:48.373Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:48.373Z InvocationID=28bd7bb0-b772-46b9-b933-2a2c620003fb 2021-07-13T00:55:48.563Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2e9dd290-e116-4fb4-b66b-2f05d52ea5b5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:48.769Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2e9dd290-e116-4fb4-b66b-2f05d52ea5b5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=396 EndTimestamp=2021-07-13T00:55:48.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:48.373Z InvocationID=ffa9ae2c-bd0a-49cb-8eed-fa172972db11 ResponseDesc=OK 2021-07-13T00:55:48.873Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=27d1137e-2825-451c-bdb4-97716d6f2e40 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:48.873Z InvocationID=3f7a128f-57cb-4098-ae00-33e2bde5d849 2021-07-13T00:55:53.720Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=27d1137e-2825-451c-bdb4-97716d6f2e40 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:53.728Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d3b283a8-6075-4751-a100-3cc431c7ba2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:53.728Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:53.728Z InvocationID=70dd0c1f-b5fe-4b93-90df-2cb7b01a3801 2021-07-13T00:55:53.857Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d3b283a8-6075-4751-a100-3cc431c7ba2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:54.060Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=27d1137e-2825-451c-bdb4-97716d6f2e40 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5187 EndTimestamp=2021-07-13T00:55:54.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:48.873Z InvocationID=c40573ac-eb74-474e-aac0-8fa710d05ff3 ResponseDesc=OK 2021-07-13T00:55:54.258Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d3b283a8-6075-4751-a100-3cc431c7ba2c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=530 EndTimestamp=2021-07-13T00:55:54.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:53.728Z InvocationID=7267dbbd-9f50-4109-8aa4-02595d286558 ResponseDesc=OK 2021-07-13T00:55:55.565Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce18b5a0-6c75-4526-93bc-3b17197ffac5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:55.565Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:55.565Z InvocationID=673ac1e1-4997-4eaa-b001-1eb376577dcb 2021-07-13T00:55:55.662Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce18b5a0-6c75-4526-93bc-3b17197ffac5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:55.875Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ce18b5a0-6c75-4526-93bc-3b17197ffac5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=310 EndTimestamp=2021-07-13T00:55:55.875Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:55.565Z InvocationID=0380522c-aee8-4af1-b17e-85d8ca7a342b ResponseDesc=OK 2021-07-13T00:55:56.963Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d98d0214-fa50-4c69-97f8-e9db2f000cac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:56.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:56.963Z InvocationID=225689a1-3eb0-435e-826e-d5f59cd7a44e 2021-07-13T00:55:57.115Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d98d0214-fa50-4c69-97f8-e9db2f000cac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:57.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=531b12a8-b319-44a0-abdb-170b4abae7cc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:57.439Z InvocationID=7241f15e-9b8c-4210-bc40-6a303963f0f7 2021-07-13T00:55:57.464Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d98d0214-fa50-4c69-97f8-e9db2f000cac InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=501 EndTimestamp=2021-07-13T00:55:57.464Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:56.963Z InvocationID=aa802dd0-6607-41d5-ba3f-e7536604c898 ResponseDesc=OK 2021-07-13T00:55:57.656Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=531b12a8-b319-44a0-abdb-170b4abae7cc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:58.363Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=531b12a8-b319-44a0-abdb-170b4abae7cc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=924 EndTimestamp=2021-07-13T00:55:58.363Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:57.439Z InvocationID=61fcf790-8571-4862-b88a-b7ddfde35060 ResponseDesc=OK 2021-07-13T00:55:58.562Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f9a53133-610a-444b-9ecd-eb9737271e64 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:58.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:58.562Z InvocationID=21fa098a-a06d-45f1-8b40-8e7ac91bac00 2021-07-13T00:55:58.759Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f9a53133-610a-444b-9ecd-eb9737271e64 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:58.873Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ba0b1773-1635-41d8-9758-4b13de91137a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:55:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:58.873Z InvocationID=aaed4da8-9a8f-4371-a361-28383cc96ca1 2021-07-13T00:55:59.120Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f9a53133-610a-444b-9ecd-eb9737271e64 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=558 EndTimestamp=2021-07-13T00:55:59.120Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:58.562Z InvocationID=7253b416-0663-4576-bcde-0d8f17d72717 ResponseDesc=OK 2021-07-13T00:55:59.126Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ba0b1773-1635-41d8-9758-4b13de91137a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:55:59.364Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ba0b1773-1635-41d8-9758-4b13de91137a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=491 EndTimestamp=2021-07-13T00:55:59.364Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:55:58.873Z InvocationID=eade9e18-3157-4e88-8d6e-5798277835ff ResponseDesc=OK 2021-07-13T00:56:00.163Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bafe5c22-0e6e-47bf-93bd-70084e3332fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:00.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:00.163Z InvocationID=992698f9-0d14-4f52-bb24-d46f131d34b3 2021-07-13T00:56:00.257Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bafe5c22-0e6e-47bf-93bd-70084e3332fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:00.963Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bafe5c22-0e6e-47bf-93bd-70084e3332fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=800 EndTimestamp=2021-07-13T00:56:00.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:00.163Z InvocationID=93a1421d-280d-42f5-a184-08c21964662a ResponseDesc=OK 2021-07-13T00:56:01.968Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fcc56cc5-50d5-4d8f-8ce9-ffe25b2dbdbd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:01.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:01.967Z InvocationID=9ce88edf-f69e-41ce-ab36-acb3450de88b 2021-07-13T00:56:02.160Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fcc56cc5-50d5-4d8f-8ce9-ffe25b2dbdbd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:02.362Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fcc56cc5-50d5-4d8f-8ce9-ffe25b2dbdbd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=395 EndTimestamp=2021-07-13T00:56:02.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:01.967Z InvocationID=d259ac94-87da-4edf-a946-ca736f28bcab ResponseDesc=OK 2021-07-13T00:56:03.371Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8295282c-918e-4d02-a1f4-01d80333c749 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:03.371Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:03.371Z InvocationID=23ef680d-19d5-44e4-b15b-9e5c32d08f6d 2021-07-13T00:56:03.466Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8295282c-918e-4d02-a1f4-01d80333c749 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:03.566Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8295282c-918e-4d02-a1f4-01d80333c749 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=195 EndTimestamp=2021-07-13T00:56:03.566Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:03.371Z InvocationID=88256b75-0185-41f1-8943-2338ebe19644 ResponseDesc=OK 2021-07-13T00:56:04.570Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=642f591b-83d3-4c02-b997-8a6ea0188136 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:04.570Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:04.570Z InvocationID=2bb07521-2523-494c-95bf-5b3f1794b640 2021-07-13T00:56:04.664Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=642f591b-83d3-4c02-b997-8a6ea0188136 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:04.771Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=642f591b-83d3-4c02-b997-8a6ea0188136 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=200 EndTimestamp=2021-07-13T00:56:04.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:04.570Z InvocationID=8df5391b-2009-426d-bdaa-948eee230fd0 ResponseDesc=OK 2021-07-13T00:56:05.963Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5ea889d9-a9ae-4754-a7ec-8b9c75ea487d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:05.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:05.962Z InvocationID=34b75180-1adf-42cd-8100-5b0192fbb36a 2021-07-13T00:56:06.061Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5ea889d9-a9ae-4754-a7ec-8b9c75ea487d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:07.439Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=79e40c07-b806-4c5d-8e84-d619267c86e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:07.439Z InvocationID=99ec6d46-4db2-4ac5-b75d-752eec75ea52 2021-07-13T00:56:08.874Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=62e50b32-0f0c-42c3-8d4e-dbd3397b2044 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:08.873Z InvocationID=f1f9aeb4-d2f4-42ab-9cb1-4633bbc7532f 2021-07-13T00:56:11.059Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=62e50b32-0f0c-42c3-8d4e-dbd3397b2044 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:11.061Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5ea889d9-a9ae-4754-a7ec-8b9c75ea487d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5099 EndTimestamp=2021-07-13T00:56:11.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:05.962Z InvocationID=2d4dd709-abd2-40d3-a104-6ca2877760f5 ResponseDesc=OK 2021-07-13T00:56:11.117Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=79e40c07-b806-4c5d-8e84-d619267c86e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:11.260Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=62e50b32-0f0c-42c3-8d4e-dbd3397b2044 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2387 EndTimestamp=2021-07-13T00:56:11.260Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:08.873Z InvocationID=15300371-ba45-414f-a759-3c144db18d26 ResponseDesc=OK 2021-07-13T00:56:11.461Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=79e40c07-b806-4c5d-8e84-d619267c86e4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4022 EndTimestamp=2021-07-13T00:56:11.461Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:07.439Z InvocationID=1c30f3e6-b012-4d1a-8a9d-4fc8c6ba781c ResponseDesc=OK 2021-07-13T00:56:11.628Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=44d186d9-b2c1-4537-aca1-6599e645bca7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:11.628Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:11.628Z InvocationID=01be4017-8429-4225-be39-e4a2b07aaa17 2021-07-13T00:56:11.763Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=44d186d9-b2c1-4537-aca1-6599e645bca7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:12.469Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=44d186d9-b2c1-4537-aca1-6599e645bca7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=841 EndTimestamp=2021-07-13T00:56:12.469Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:11.628Z InvocationID=87c3c24c-16e0-436e-98ad-631f538b336f ResponseDesc=OK 2021-07-13T00:56:16.624Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f3739496-c78e-46dd-974b-c50100fdb663 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:16.624Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:16.624Z InvocationID=350d00c6-bac4-443e-8c25-88f03ff6210f 2021-07-13T00:56:17.412Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f3739496-c78e-46dd-974b-c50100fdb663 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:17.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3dd56cc4-6c99-4608-a14f-a2a474af448e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:17.439Z InvocationID=b4a398e0-a78b-4379-8f73-a91a93c85463 2021-07-13T00:56:17.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3dd56cc4-6c99-4608-a14f-a2a474af448e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:17.659Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f3739496-c78e-46dd-974b-c50100fdb663 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1035 EndTimestamp=2021-07-13T00:56:17.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:16.624Z InvocationID=dca6cf89-4a27-4651-98e2-4bdee97175c3 ResponseDesc=OK 2021-07-13T00:56:18.257Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3dd56cc4-6c99-4608-a14f-a2a474af448e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=818 EndTimestamp=2021-07-13T00:56:18.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:17.439Z InvocationID=0544e1a8-fd5b-4b92-8d5a-1b91919cde4f ResponseDesc=OK 2021-07-13T00:56:18.825Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d4c0c423-98c8-4664-ac41-c402db6ed37a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:18.825Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:18.825Z InvocationID=2bf78fb1-114d-44d4-8326-79428b86bcfe 2021-07-13T00:56:18.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ddde9a6d-f5f0-4b2e-ad18-5f670d9a849b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:18.873Z InvocationID=1006c8ad-d232-4e29-abf4-42a70e8457dc 2021-07-13T00:56:18.959Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d4c0c423-98c8-4664-ac41-c402db6ed37a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:19.068Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ddde9a6d-f5f0-4b2e-ad18-5f670d9a849b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:22.060Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d4c0c423-98c8-4664-ac41-c402db6ed37a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3235 EndTimestamp=2021-07-13T00:56:22.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:18.825Z InvocationID=809a609b-d9db-49bd-8d35-11af6e214690 ResponseDesc=OK 2021-07-13T00:56:22.111Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ddde9a6d-f5f0-4b2e-ad18-5f670d9a849b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3238 EndTimestamp=2021-07-13T00:56:22.111Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:18.873Z InvocationID=6f5cf177-7873-473b-82ad-432d1009ac47 ResponseDesc=OK 2021-07-13T00:56:23.472Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=572c610c-3632-4736-9305-540ca8ab15d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:23.472Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:23.472Z InvocationID=f5c0bb40-6d26-4996-8380-1736691f5a72 2021-07-13T00:56:23.656Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=572c610c-3632-4736-9305-540ca8ab15d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:23.857Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=572c610c-3632-4736-9305-540ca8ab15d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=385 EndTimestamp=2021-07-13T00:56:23.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:23.472Z InvocationID=b27b9e78-433d-4e35-8a8f-44714bb5ae58 ResponseDesc=OK 2021-07-13T00:56:25.067Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=884dc639-a9fa-497e-a494-cfe360c8290c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:25.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:25.067Z InvocationID=7c63ac55-8f3d-4d6a-9529-c02a6388f985 2021-07-13T00:56:25.159Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=884dc639-a9fa-497e-a494-cfe360c8290c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:25.262Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=884dc639-a9fa-497e-a494-cfe360c8290c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=194 EndTimestamp=2021-07-13T00:56:25.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:25.067Z InvocationID=5952b596-c20e-4d52-b14f-570f644eca9b ResponseDesc=OK 2021-07-13T00:56:26.173Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=22227ca0-e5e1-4b32-ab2e-3918502b9959 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:26.173Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:26.173Z InvocationID=e6b6b98a-71c7-4b07-9927-d353e81e8c38 2021-07-13T00:56:26.390Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=22227ca0-e5e1-4b32-ab2e-3918502b9959 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:26.659Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=22227ca0-e5e1-4b32-ab2e-3918502b9959 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=486 EndTimestamp=2021-07-13T00:56:26.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:26.173Z InvocationID=4aff3860-82bf-4ae2-ac80-6ae10ad6b965 ResponseDesc=OK 2021-07-13T00:56:27.439Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dc5bf93e-af95-4269-b35a-2fc90a6675bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:27.439Z InvocationID=ed24373f-89f1-4fc4-9c8c-2031ca51897a 2021-07-13T00:56:27.556Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dc5bf93e-af95-4269-b35a-2fc90a6675bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:27.756Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dc5bf93e-af95-4269-b35a-2fc90a6675bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=317 EndTimestamp=2021-07-13T00:56:27.756Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:27.439Z InvocationID=34c12540-38bc-43b5-9373-bfe67e80f032 ResponseDesc=OK 2021-07-13T00:56:27.965Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be98fc20-0d87-4969-a2f4-050de8b4849c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:27.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:27.965Z InvocationID=73a8b154-a187-4d84-bbf2-9febcf111c2e 2021-07-13T00:56:28.079Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be98fc20-0d87-4969-a2f4-050de8b4849c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:28.284Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be98fc20-0d87-4969-a2f4-050de8b4849c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=319 EndTimestamp=2021-07-13T00:56:28.284Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:27.965Z InvocationID=095b939d-cae6-4dbb-a8fc-c25334ee81a5 ResponseDesc=OK 2021-07-13T00:56:28.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b72a29db-5b5c-4d30-9a5d-c08e67fa3532 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:28.873Z InvocationID=9e2a3f39-71c2-4d25-8bd1-61b55c45ce50 2021-07-13T00:56:29.314Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b72a29db-5b5c-4d30-9a5d-c08e67fa3532 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:29.559Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b72a29db-5b5c-4d30-9a5d-c08e67fa3532 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=686 EndTimestamp=2021-07-13T00:56:29.559Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:28.873Z InvocationID=e036072b-9f22-46fe-a217-d7081336c49d ResponseDesc=OK 2021-07-13T00:56:29.969Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9f478168-311a-4c29-8cd6-866d22e76f6d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:29.969Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:29.969Z InvocationID=54077839-7545-451e-9e8c-5a54d34e84d9 2021-07-13T00:56:30.256Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9f478168-311a-4c29-8cd6-866d22e76f6d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:30.369Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9f478168-311a-4c29-8cd6-866d22e76f6d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=400 EndTimestamp=2021-07-13T00:56:30.369Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:29.969Z InvocationID=9c2d382b-4007-41e3-a338-1f4bab379a55 ResponseDesc=OK 2021-07-13T00:56:32.866Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bda79470-b4eb-48a1-ace9-837bb73d99fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:32.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:32.866Z InvocationID=d88b5b2d-40cd-4609-b7f5-24e297c5814f 2021-07-13T00:56:33.059Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bda79470-b4eb-48a1-ace9-837bb73d99fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:33.317Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bda79470-b4eb-48a1-ace9-837bb73d99fe InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=451 EndTimestamp=2021-07-13T00:56:33.317Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:32.866Z InvocationID=83ca03b7-9088-4c2b-990a-4f044a66432d ResponseDesc=OK 2021-07-13T00:56:36.019Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e53847ba-7094-4001-a7eb-7a4afed65be0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:36.019Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:36.019Z InvocationID=d2db4dd5-b642-4955-b8e8-3026fae8dd31 2021-07-13T00:56:36.228Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e53847ba-7094-4001-a7eb-7a4afed65be0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:36.459Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e53847ba-7094-4001-a7eb-7a4afed65be0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=440 EndTimestamp=2021-07-13T00:56:36.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:36.019Z InvocationID=0bc32e09-c1ad-4cdd-aa0a-0843e768231e ResponseDesc=OK 2021-07-13T00:56:37.440Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d2f0b136-04ae-4815-9ebb-c6acd6689d4b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:37.439Z InvocationID=62732d5e-6a31-4251-9d9b-894fbc6b480e 2021-07-13T00:56:37.557Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d2f0b136-04ae-4815-9ebb-c6acd6689d4b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:38.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4e7d0588-59ef-4640-8c76-1080b611ae5d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:38.873Z InvocationID=78c84030-6362-4b6d-a0cd-6ca97b4ef3f0 2021-07-13T00:56:40.457Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d2f0b136-04ae-4815-9ebb-c6acd6689d4b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3018 EndTimestamp=2021-07-13T00:56:40.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:37.439Z InvocationID=64d0cb57-6a7a-4fd7-b2d7-e32faeaa639d ResponseDesc=OK 2021-07-13T00:56:40.458Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4e7d0588-59ef-4640-8c76-1080b611ae5d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:41.016Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4e7d0588-59ef-4640-8c76-1080b611ae5d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2143 EndTimestamp=2021-07-13T00:56:41.016Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:38.873Z InvocationID=4ddd9da8-7570-4bcd-b882-98c6b0e52116 ResponseDesc=OK 2021-07-13T00:56:41.321Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=335e1f17-41ba-46d0-ba3b-24ce15c9b2c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:41.321Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:41.321Z InvocationID=fb341b02-bfb4-485f-b8db-f1918cf04b60 2021-07-13T00:56:41.920Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=335e1f17-41ba-46d0-ba3b-24ce15c9b2c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:42.164Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=335e1f17-41ba-46d0-ba3b-24ce15c9b2c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=842 EndTimestamp=2021-07-13T00:56:42.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:41.321Z InvocationID=6e53045f-b0bc-4289-ab61-24e8ac9d2448 ResponseDesc=OK 2021-07-13T00:56:43.723Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ab525d14-dca3-45ad-a479-153d6f78a0f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:43.723Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:43.723Z InvocationID=fecbea8a-c206-44de-ace3-c45931c6e7d2 2021-07-13T00:56:43.859Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ab525d14-dca3-45ad-a479-153d6f78a0f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:44.357Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ab525d14-dca3-45ad-a479-153d6f78a0f5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=634 EndTimestamp=2021-07-13T00:56:44.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:43.723Z InvocationID=72b2a60e-4338-4da7-bba1-7deca238c260 ResponseDesc=OK 2021-07-13T00:56:45.271Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=adf65108-136f-4f68-bb86-0e3ec4e06642 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:45.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:45.271Z InvocationID=e13d6b69-2eef-4cf2-9b35-aa3a0c5e181a 2021-07-13T00:56:45.460Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=adf65108-136f-4f68-bb86-0e3ec4e06642 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:45.831Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=adf65108-136f-4f68-bb86-0e3ec4e06642 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=559 EndTimestamp=2021-07-13T00:56:45.830Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:45.271Z InvocationID=ddbaca1b-28ad-4a0c-a561-d1374194c5df ResponseDesc=OK 2021-07-13T00:56:47.439Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5890d43a-b722-48ca-81f6-ca93a8282188 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:47.439Z InvocationID=59481952-275c-4d5d-aee6-3fd77bdb192e 2021-07-13T00:56:47.719Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5890d43a-b722-48ca-81f6-ca93a8282188 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:48.059Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5890d43a-b722-48ca-81f6-ca93a8282188 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=620 EndTimestamp=2021-07-13T00:56:48.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:47.439Z InvocationID=c2a9e196-e9c2-458f-8147-147526c681e4 ResponseDesc=OK 2021-07-13T00:56:48.225Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cb92741a-e560-41b6-b845-2f6403f808ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:48.225Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:48.225Z InvocationID=662e2635-c691-49f7-861b-fe6a8a28e38e 2021-07-13T00:56:48.356Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cb92741a-e560-41b6-b845-2f6403f808ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:48.674Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cb92741a-e560-41b6-b845-2f6403f808ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=449 EndTimestamp=2021-07-13T00:56:48.674Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:48.225Z InvocationID=89ad9e96-b007-4873-8498-bf6a9427a591 ResponseDesc=OK 2021-07-13T00:56:48.873Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b8d1d26e-9e10-4269-b1d4-fb4176ab2594 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:48.873Z InvocationID=9b127bbd-02cd-488b-8588-741a556d92cb 2021-07-13T00:56:48.962Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b8d1d26e-9e10-4269-b1d4-fb4176ab2594 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:49.335Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b8d1d26e-9e10-4269-b1d4-fb4176ab2594 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=462 EndTimestamp=2021-07-13T00:56:49.335Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:48.873Z InvocationID=798e8400-0cb0-4589-b0e3-690f754780c9 ResponseDesc=OK 2021-07-13T00:56:51.064Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=026d8017-18cc-4c5a-9cbe-30adf3fe04c4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:51.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:51.064Z InvocationID=cec912c8-5e0b-43e8-9182-e64225339a03 2021-07-13T00:56:51.333Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=026d8017-18cc-4c5a-9cbe-30adf3fe04c4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:51.560Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=026d8017-18cc-4c5a-9cbe-30adf3fe04c4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T00:56:51.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:51.064Z InvocationID=fc6c57ab-7c0c-4416-b4a1-70442d344f21 ResponseDesc=OK 2021-07-13T00:56:54.067Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0be8eeab-bba9-4f30-baba-dac59af36d65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:54.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:54.066Z InvocationID=eb5b53c0-2392-4a9a-9efa-bd807eb50807 2021-07-13T00:56:54.257Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0be8eeab-bba9-4f30-baba-dac59af36d65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:54.659Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0be8eeab-bba9-4f30-baba-dac59af36d65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=593 EndTimestamp=2021-07-13T00:56:54.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:54.066Z InvocationID=42c883ee-5075-4c99-91d7-8691ab237dba ResponseDesc=OK 2021-07-13T00:56:57.266Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8de9f899-6489-42f4-95e5-ce2cda828323 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:57.266Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:57.266Z InvocationID=74948872-0141-4471-8be2-be70f8617403 2021-07-13T00:56:57.410Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8de9f899-6489-42f4-95e5-ce2cda828323 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:57.440Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d70f4427-393a-4b54-be44-00419eb26efb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:57.440Z InvocationID=5519648b-7db2-4d8e-aa6c-8152769cd9bb 2021-07-13T00:56:57.613Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d70f4427-393a-4b54-be44-00419eb26efb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:57.819Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8de9f899-6489-42f4-95e5-ce2cda828323 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=553 EndTimestamp=2021-07-13T00:56:57.819Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:57.266Z InvocationID=1a35b0c9-31eb-4bda-97f1-4419c1ec196b ResponseDesc=OK 2021-07-13T00:56:57.859Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d70f4427-393a-4b54-be44-00419eb26efb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=419 EndTimestamp=2021-07-13T00:56:57.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:57.440Z InvocationID=18a437d1-7918-4232-9579-bd63a8e29fdd ResponseDesc=OK 2021-07-13T00:56:58.873Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bb0688c0-2375-45d9-b293-0f924b9520ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:56:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:58.873Z InvocationID=fc7be1d8-f723-40ec-bcbe-e3a291abcf34 2021-07-13T00:56:59.056Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bb0688c0-2375-45d9-b293-0f924b9520ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:56:59.857Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bb0688c0-2375-45d9-b293-0f924b9520ea InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=984 EndTimestamp=2021-07-13T00:56:59.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:56:58.873Z InvocationID=09ce3c00-91c6-4e75-9dc8-4cd3c7b8d068 ResponseDesc=OK 2021-07-13T00:57:00.014Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c60a0c7b-0da5-4ed4-b906-d4fec4d62f48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:00.014Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:00.014Z InvocationID=fb6d668f-2264-405a-a33b-4d65c95b3054 2021-07-13T00:57:00.160Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c60a0c7b-0da5-4ed4-b906-d4fec4d62f48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:00.531Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c60a0c7b-0da5-4ed4-b906-d4fec4d62f48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=517 EndTimestamp=2021-07-13T00:57:00.531Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:00.014Z InvocationID=fc56b0e8-b3f0-46d2-a416-204d76b23fdf ResponseDesc=OK 2021-07-13T00:57:02.966Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c635f496-c610-4411-8cc6-c0ab7990f628 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:02.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:02.966Z InvocationID=5a520023-0dcf-4087-b37c-0051f08df254 2021-07-13T00:57:05.918Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c635f496-c610-4411-8cc6-c0ab7990f628 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:06.068Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c635f496-c610-4411-8cc6-c0ab7990f628 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3102 EndTimestamp=2021-07-13T00:57:06.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:02.966Z InvocationID=7a899f2e-20c1-4388-adf8-b0ec44ae75c7 ResponseDesc=OK 2021-07-13T00:57:07.315Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f616bfa9-3c18-4667-9385-12427d8f685e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:07.315Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:07.315Z InvocationID=0f4a109a-177c-4e07-90c7-37bd2f59e3eb 2021-07-13T00:57:07.439Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c5cbc101-25d3-4539-a818-f1ae5f6cc798 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:07.439Z InvocationID=ef851db3-6003-454a-a162-5c86d53dc3b1 2021-07-13T00:57:07.456Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f616bfa9-3c18-4667-9385-12427d8f685e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:08.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c87466e0-690a-4f01-b5fc-fdf0f03a493a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:08.873Z InvocationID=38fe563c-fcba-491e-8f85-9c2983974a9e 2021-07-13T00:57:09.557Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c87466e0-690a-4f01-b5fc-fdf0f03a493a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:09.657Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f616bfa9-3c18-4667-9385-12427d8f685e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2341 EndTimestamp=2021-07-13T00:57:09.656Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:07.315Z InvocationID=f4a29d08-7428-49ca-ac1c-fa1ce4d47787 ResponseDesc=OK 2021-07-13T00:57:09.723Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c5cbc101-25d3-4539-a818-f1ae5f6cc798 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:09.867Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c5cbc101-25d3-4539-a818-f1ae5f6cc798 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2428 EndTimestamp=2021-07-13T00:57:09.867Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:07.439Z InvocationID=7f70d394-c527-4bdb-826a-df209fc07df0 ResponseDesc=OK 2021-07-13T00:57:09.963Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c87466e0-690a-4f01-b5fc-fdf0f03a493a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1090 EndTimestamp=2021-07-13T00:57:09.963Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:08.873Z InvocationID=3c45909a-17dd-43ce-850f-aaa470820360 ResponseDesc=OK 2021-07-13T00:57:10.565Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=413ae34e-72ba-45a6-b3ab-bc50206b9930 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:10.565Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:10.565Z InvocationID=8f06c386-8ac4-4707-b135-c110f8ac032c 2021-07-13T00:57:10.671Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=413ae34e-72ba-45a6-b3ab-bc50206b9930 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:10.964Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=413ae34e-72ba-45a6-b3ab-bc50206b9930 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=399 EndTimestamp=2021-07-13T00:57:10.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:10.565Z InvocationID=5901ac80-cd5e-4574-96ad-282a9afb82cb ResponseDesc=OK 2021-07-13T00:57:11.973Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2548ba2f-9524-439b-b229-f4869ae5dbe0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:11.973Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:11.973Z InvocationID=ae34983c-ff3b-474a-8587-308bc6625ba0 2021-07-13T00:57:12.159Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2548ba2f-9524-439b-b229-f4869ae5dbe0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:12.514Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2548ba2f-9524-439b-b229-f4869ae5dbe0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=541 EndTimestamp=2021-07-13T00:57:12.514Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:11.973Z InvocationID=2f6f4399-f443-4c21-ad2c-5b8608eebbd8 ResponseDesc=OK 2021-07-13T00:57:14.866Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7d8480fb-7fd4-4f93-a1f1-427554018d19 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:14.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:14.866Z InvocationID=9b37c465-8f9a-4253-9ed3-d9a42e40b1da 2021-07-13T00:57:15.031Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7d8480fb-7fd4-4f93-a1f1-427554018d19 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:15.162Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7d8480fb-7fd4-4f93-a1f1-427554018d19 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=296 EndTimestamp=2021-07-13T00:57:15.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:14.866Z InvocationID=88c97c07-7aac-4c38-9bdd-710e41a520bd ResponseDesc=OK 2021-07-13T00:57:17.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c270cf21-a0c9-4270-b149-fc3bb2adc5c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:17.439Z InvocationID=e8567ce1-47df-4a55-acfb-4d5ebbf91588 2021-07-13T00:57:17.656Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c270cf21-a0c9-4270-b149-fc3bb2adc5c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:17.765Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=71a4c63f-8feb-4651-8ee4-10eb3a7bfea6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:17.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:17.765Z InvocationID=52758879-6b34-41f4-8f3d-92475f11b0a7 2021-07-13T00:57:17.860Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=71a4c63f-8feb-4651-8ee4-10eb3a7bfea6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:18.058Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c270cf21-a0c9-4270-b149-fc3bb2adc5c8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=619 EndTimestamp=2021-07-13T00:57:18.058Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:17.439Z InvocationID=33248b34-321e-414f-867f-398885821856 ResponseDesc=OK 2021-07-13T00:57:18.211Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=71a4c63f-8feb-4651-8ee4-10eb3a7bfea6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=446 EndTimestamp=2021-07-13T00:57:18.211Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:17.765Z InvocationID=98a0b507-7bd3-46f1-be3f-e23feff195f1 ResponseDesc=OK 2021-07-13T00:57:18.873Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a1a15dfb-36c2-4c67-a2e9-5df98ad09538 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:18.873Z InvocationID=e7e9eb7a-aee0-458e-a280-5348f4e25393 2021-07-13T00:57:19.014Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a1a15dfb-36c2-4c67-a2e9-5df98ad09538 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:19.259Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a1a15dfb-36c2-4c67-a2e9-5df98ad09538 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=386 EndTimestamp=2021-07-13T00:57:19.259Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:18.873Z InvocationID=3aa399ad-764c-4847-a48f-f8586b0343f8 ResponseDesc=OK 2021-07-13T00:57:20.975Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2094923c-4f45-4df4-8d68-38edebe27bdb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:20.975Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:20.975Z InvocationID=536c3dcd-ccc1-4db0-9ae9-d97cafb41960 2021-07-13T00:57:21.379Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2094923c-4f45-4df4-8d68-38edebe27bdb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:21.757Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2094923c-4f45-4df4-8d68-38edebe27bdb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=782 EndTimestamp=2021-07-13T00:57:21.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:20.975Z InvocationID=5508693c-9de3-497f-b36d-97062459c36f ResponseDesc=OK 2021-07-13T00:57:23.569Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8d132ad0-0872-453c-b019-997640fb9601 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:23.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:23.569Z InvocationID=31f98dae-6455-46fc-947d-10e9c7250243 2021-07-13T00:57:23.759Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8d132ad0-0872-453c-b019-997640fb9601 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:23.962Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8d132ad0-0872-453c-b019-997640fb9601 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=393 EndTimestamp=2021-07-13T00:57:23.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:23.569Z InvocationID=4bf2f0b9-ecf5-4556-b0cc-eddb851b31c5 ResponseDesc=OK 2021-07-13T00:57:26.870Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=24924ecc-8cc1-4de0-add1-c3d70ea93d76 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:26.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:26.870Z InvocationID=2db99563-88c9-4cb4-99f0-146b140337ab 2021-07-13T00:57:26.966Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=24924ecc-8cc1-4de0-add1-c3d70ea93d76 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:27.068Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=24924ecc-8cc1-4de0-add1-c3d70ea93d76 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=198 EndTimestamp=2021-07-13T00:57:27.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:26.870Z InvocationID=f4052135-c06a-4b92-9a75-52c9956e61ec ResponseDesc=OK 2021-07-13T00:57:27.439Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=97d99389-5ecd-456f-91f1-0b87c3ac0959 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:27.439Z InvocationID=1f562552-e039-41be-8046-9e80058d7df5 2021-07-13T00:57:27.661Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=97d99389-5ecd-456f-91f1-0b87c3ac0959 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:27.767Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=97d99389-5ecd-456f-91f1-0b87c3ac0959 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=328 EndTimestamp=2021-07-13T00:57:27.767Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:27.439Z InvocationID=0561048c-df7f-4919-a55a-cdff1df42358 ResponseDesc=OK 2021-07-13T00:57:28.874Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8f266ff3-44a3-490f-84ef-eed1333626e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:28.874Z InvocationID=153e6337-004b-4519-822b-aef5da19397e 2021-07-13T00:57:29.759Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8f266ff3-44a3-490f-84ef-eed1333626e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:31.671Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fe1be28c-5c08-45d6-ad24-c523d02ff20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:31.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:31.671Z InvocationID=04ffd8b3-dd34-4a4f-94e8-c8b28509050b 2021-07-13T00:57:31.671Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8f266ff3-44a3-490f-84ef-eed1333626e9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2797 EndTimestamp=2021-07-13T00:57:31.671Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:28.874Z InvocationID=55171b43-de98-498a-92e1-f4f65ae0e268 ResponseDesc=OK 2021-07-13T00:57:31.916Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fe1be28c-5c08-45d6-ad24-c523d02ff20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:32.160Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fe1be28c-5c08-45d6-ad24-c523d02ff20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=488 EndTimestamp=2021-07-13T00:57:32.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:31.671Z InvocationID=3a3bbed1-0a1c-46d3-9a46-64a7f2002134 ResponseDesc=OK 2021-07-13T00:57:33.174Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3f271e00-8c29-4e3b-b244-30442c492e85 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:33.173Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:33.173Z InvocationID=b346ccd3-0840-4491-9d52-9e8c274d0de2 2021-07-13T00:57:33.356Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3f271e00-8c29-4e3b-b244-30442c492e85 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:33.460Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3f271e00-8c29-4e3b-b244-30442c492e85 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=286 EndTimestamp=2021-07-13T00:57:33.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:33.173Z InvocationID=a9f3843e-0ca3-417e-a436-b535f19a3abe ResponseDesc=OK 2021-07-13T00:57:36.061Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=61755efc-0c57-465c-bf39-fabd5afd027b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:36.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:36.061Z InvocationID=b282541f-fabb-42f9-974b-bdaa81b4c1ce 2021-07-13T00:57:37.161Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=61755efc-0c57-465c-bf39-fabd5afd027b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:37.440Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cd756cc6-ac56-4d94-8b62-2038857bad59 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:37.440Z InvocationID=8232a446-b2c8-4655-9a0c-080db8c39ba6 2021-07-13T00:57:37.816Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cd756cc6-ac56-4d94-8b62-2038857bad59 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:37.965Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cd756cc6-ac56-4d94-8b62-2038857bad59 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=525 EndTimestamp=2021-07-13T00:57:37.965Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:37.440Z InvocationID=165a59ce-b199-4454-bbf9-5b833578462b ResponseDesc=OK 2021-07-13T00:57:37.968Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=61755efc-0c57-465c-bf39-fabd5afd027b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1907 EndTimestamp=2021-07-13T00:57:37.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:36.061Z InvocationID=abe223c6-41a2-461c-9057-fc9d710deb70 ResponseDesc=OK 2021-07-13T00:57:38.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=df56b82b-073f-49c2-9bbd-3596f20801e1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:38.873Z InvocationID=e01c1aa3-039b-44ba-af09-10c0f804fbe7 2021-07-13T00:57:39.056Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=df56b82b-073f-49c2-9bbd-3596f20801e1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:39.258Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=df56b82b-073f-49c2-9bbd-3596f20801e1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=384 EndTimestamp=2021-07-13T00:57:39.257Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:38.873Z InvocationID=9f59665e-9e98-4f74-9464-504eea05351b ResponseDesc=OK 2021-07-13T00:57:39.262Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7199c810-b95a-43be-b6b4-39f318022a6c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:39.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:39.261Z InvocationID=bf0744db-7274-42e9-8508-0be9b0f2b90c 2021-07-13T00:57:39.269Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7199c810-b95a-43be-b6b4-39f318022a6c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:39.576Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7199c810-b95a-43be-b6b4-39f318022a6c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=315 EndTimestamp=2021-07-13T00:57:39.576Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:39.261Z InvocationID=305c48c2-852b-464f-b2ef-74ede7eb17c5 ResponseDesc=OK 2021-07-13T00:57:41.871Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5ab13866-360c-4b15-a67c-ba36a127b261 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:41.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:41.871Z InvocationID=f8b36243-b437-4f0c-b180-123766f0f4d9 2021-07-13T00:57:41.971Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5ab13866-360c-4b15-a67c-ba36a127b261 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:42.160Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5ab13866-360c-4b15-a67c-ba36a127b261 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=289 EndTimestamp=2021-07-13T00:57:42.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:41.871Z InvocationID=39f492a0-a811-45ad-9889-68b27f07a01e ResponseDesc=OK 2021-07-13T00:57:44.873Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f0078c90-f03b-4824-8145-bc2872442a28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:44.872Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:44.872Z InvocationID=0fdf8f59-b849-4533-bde9-a6272c3a99c3 2021-07-13T00:57:44.967Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f0078c90-f03b-4824-8145-bc2872442a28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:45.161Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f0078c90-f03b-4824-8145-bc2872442a28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=289 EndTimestamp=2021-07-13T00:57:45.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:44.872Z InvocationID=a0e71134-ec79-4c9b-a65b-3e9a6e7c3039 ResponseDesc=OK 2021-07-13T00:57:47.439Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bfc982bf-6730-45be-8a44-d3e2b4960d07 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:47.439Z InvocationID=9ee9b60c-3976-4667-b1ae-11a00509ec23 2021-07-13T00:57:47.562Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bfc982bf-6730-45be-8a44-d3e2b4960d07 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:48.047Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bfc982bf-6730-45be-8a44-d3e2b4960d07 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=608 EndTimestamp=2021-07-13T00:57:48.047Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:47.439Z InvocationID=80cdec8e-4284-4a7e-9457-d9c09c0e4623 ResponseDesc=OK 2021-07-13T00:57:48.163Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3f8c5dd1-a635-4f40-bf3c-89999173e948 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:48.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:48.163Z InvocationID=4d244870-76a9-47f2-aa9d-632153af3ff6 2021-07-13T00:57:48.266Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3f8c5dd1-a635-4f40-bf3c-89999173e948 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:48.368Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3f8c5dd1-a635-4f40-bf3c-89999173e948 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=205 EndTimestamp=2021-07-13T00:57:48.368Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:48.163Z InvocationID=3546f6da-d305-42b2-b479-0b91668258c7 ResponseDesc=OK 2021-07-13T00:57:48.874Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a3eb0768-6820-485f-bd62-09e353b3f979 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:48.873Z InvocationID=8f5061bc-f543-47b3-9a18-61f74139cb3e 2021-07-13T00:57:49.169Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a3eb0768-6820-485f-bd62-09e353b3f979 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:49.365Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a3eb0768-6820-485f-bd62-09e353b3f979 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=492 EndTimestamp=2021-07-13T00:57:49.365Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:48.873Z InvocationID=1bf95341-9480-470a-8664-473467fc87e9 ResponseDesc=OK 2021-07-13T00:57:51.498Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b213ec34-5914-4373-b9ca-3e0cfa628f7e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:51.498Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:51.498Z InvocationID=de347a2d-d24d-4ea2-abe5-f7de60752f7d 2021-07-13T00:57:51.659Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b213ec34-5914-4373-b9ca-3e0cfa628f7e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:51.875Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b213ec34-5914-4373-b9ca-3e0cfa628f7e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=376 EndTimestamp=2021-07-13T00:57:51.874Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:51.498Z InvocationID=0e60ef98-b006-4ac9-af65-bd222aaa4c97 ResponseDesc=OK 2021-07-13T00:57:53.667Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be0d33b1-6a39-4520-96ec-36a1d08f87ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:53.666Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:53.666Z InvocationID=9fa9f701-d386-48df-a37f-8f90bf1e2647 2021-07-13T00:57:53.961Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be0d33b1-6a39-4520-96ec-36a1d08f87ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:54.259Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be0d33b1-6a39-4520-96ec-36a1d08f87ff InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=593 EndTimestamp=2021-07-13T00:57:54.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:53.666Z InvocationID=ce178dc5-94d6-401c-bda8-96713d2e5971 ResponseDesc=OK 2021-07-13T00:57:56.867Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=71266407-251b-4183-bb51-c2ad6a32bb74 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:56.867Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:56.867Z InvocationID=f712982c-d0e6-427b-ae81-dc6bb8221bc9 2021-07-13T00:57:57.056Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=71266407-251b-4183-bb51-c2ad6a32bb74 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:57.357Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=71266407-251b-4183-bb51-c2ad6a32bb74 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=490 EndTimestamp=2021-07-13T00:57:57.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:56.867Z InvocationID=9451c334-d57f-462c-ba09-c280b1ececd2 ResponseDesc=OK 2021-07-13T00:57:57.439Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3e4e82f5-faf0-40fd-8494-b64ba9a4767e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:57.439Z InvocationID=586531e3-40b1-4eb0-8262-f0dfc680ed1f 2021-07-13T00:57:57.559Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3e4e82f5-faf0-40fd-8494-b64ba9a4767e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:57.870Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3e4e82f5-faf0-40fd-8494-b64ba9a4767e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=431 EndTimestamp=2021-07-13T00:57:57.870Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:57.439Z InvocationID=6e2136ae-736a-4bc7-b58b-ad5ddc6cad53 ResponseDesc=OK 2021-07-13T00:57:58.874Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=79852f46-100b-42bd-aa92-1be45fbda18d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:58.874Z InvocationID=413ae40f-91e8-4f8f-b09b-6d1445691a03 2021-07-13T00:57:59.858Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=79852f46-100b-42bd-aa92-1be45fbda18d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:57:59.883Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=810d740d-4703-4764-89ee-bd4b3525d454 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:57:59.883Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:59.883Z InvocationID=2af9d742-4e5b-44ad-9aa4-05c6dae70d21 2021-07-13T00:58:00.056Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=810d740d-4703-4764-89ee-bd4b3525d454 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:00.059Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=79852f46-100b-42bd-aa92-1be45fbda18d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1185 EndTimestamp=2021-07-13T00:58:00.059Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:58.874Z InvocationID=0ecc2b11-fca2-4d27-a19c-3bc46e2b0932 ResponseDesc=OK 2021-07-13T00:58:00.362Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=810d740d-4703-4764-89ee-bd4b3525d454 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=479 EndTimestamp=2021-07-13T00:58:00.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:57:59.883Z InvocationID=65341c70-edd9-4a93-9b6f-1de4d21ea3f1 ResponseDesc=OK 2021-07-13T00:58:02.721Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=01562d5d-fc9e-47af-b996-f76e469b9931 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:02.721Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:02.721Z InvocationID=b8f21270-9b29-47a7-beaa-67b873ce3a9f 2021-07-13T00:58:02.959Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=01562d5d-fc9e-47af-b996-f76e469b9931 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:03.287Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=01562d5d-fc9e-47af-b996-f76e469b9931 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=566 EndTimestamp=2021-07-13T00:58:03.287Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:02.721Z InvocationID=2f71f608-3b42-4147-898b-922b46e2f086 ResponseDesc=OK 2021-07-13T00:58:05.563Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d1160a11-01fe-4c66-987f-4ed0b2bff642 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:05.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:05.562Z InvocationID=a4c9a65b-24d7-4d87-a1c9-8a045a87fdbf 2021-07-13T00:58:05.676Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d1160a11-01fe-4c66-987f-4ed0b2bff642 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:05.859Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d1160a11-01fe-4c66-987f-4ed0b2bff642 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=297 EndTimestamp=2021-07-13T00:58:05.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:05.562Z InvocationID=9664bab9-cf6b-4e9a-804b-bd342d1083a6 ResponseDesc=OK 2021-07-13T00:58:07.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=df4c9c71-adf4-4793-a7a5-ec6f00c693d9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:07.439Z InvocationID=fc1912d3-4c56-4c03-8fd2-0fe48a24fda1 2021-07-13T00:58:07.558Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=df4c9c71-adf4-4793-a7a5-ec6f00c693d9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:08.873Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9dd764a7-22ec-49f2-8bb1-172281fdfcf9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:08.873Z InvocationID=e4c8ee4e-d8d0-4b27-a7e4-f639c28a0112 2021-07-13T00:58:11.564Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=87bb3b42-c8ef-4da2-a357-81140368cb77 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:11.564Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:11.564Z InvocationID=bdf52596-638f-4ccd-b071-67085012a8f3 2021-07-13T00:58:11.657Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=87bb3b42-c8ef-4da2-a357-81140368cb77 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:12.263Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9dd764a7-22ec-49f2-8bb1-172281fdfcf9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:12.467Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9dd764a7-22ec-49f2-8bb1-172281fdfcf9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3594 EndTimestamp=2021-07-13T00:58:12.467Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:08.873Z InvocationID=30937457-a2db-442e-ac8b-8fb681e964f8 ResponseDesc=OK 2021-07-13T00:58:12.468Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=df4c9c71-adf4-4793-a7a5-ec6f00c693d9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=5028 EndTimestamp=2021-07-13T00:58:12.467Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:07.439Z InvocationID=e30d3295-acd9-4b51-8e3c-48a6d7642e24 ResponseDesc=OK 2021-07-13T00:58:12.470Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=87bb3b42-c8ef-4da2-a357-81140368cb77 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=905 EndTimestamp=2021-07-13T00:58:12.469Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:11.564Z InvocationID=1f22112c-ed55-4fd1-b7b8-5143e138201a ResponseDesc=OK 2021-07-13T00:58:13.573Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=16742c29-37a5-403a-a6c2-2aa7620a9e28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:13.573Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:13.573Z InvocationID=005ca364-7837-48d7-b8a0-2d4089e593cf 2021-07-13T00:58:13.668Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=16742c29-37a5-403a-a6c2-2aa7620a9e28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:13.957Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=16742c29-37a5-403a-a6c2-2aa7620a9e28 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=383 EndTimestamp=2021-07-13T00:58:13.956Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:13.573Z InvocationID=f017d323-042d-47aa-822e-dfea1d5ecbdf ResponseDesc=OK 2021-07-13T00:58:15.421Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b705853e-517a-47dd-9510-179cb21f758a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:15.421Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:15.421Z InvocationID=13dda0f8-81b3-41f8-a029-44edc1cdc7e0 2021-07-13T00:58:15.559Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b705853e-517a-47dd-9510-179cb21f758a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:15.869Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b705853e-517a-47dd-9510-179cb21f758a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=448 EndTimestamp=2021-07-13T00:58:15.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:15.421Z InvocationID=77c3ba9a-e5df-4e7f-bd6d-f32cb9a2c654 ResponseDesc=OK 2021-07-13T00:58:17.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b4c67483-1816-42b5-b44a-f18634fbdef1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:17.439Z InvocationID=ea4abcf1-545c-4ecb-a73a-2f67062fd231 2021-07-13T00:58:17.765Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f37a57f0-fad2-49ed-849c-4c718e2ce768 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:17.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:17.765Z InvocationID=8f22282c-3777-4729-a5b4-8bf7507dde21 2021-07-13T00:58:17.965Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f37a57f0-fad2-49ed-849c-4c718e2ce768 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:17.976Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b4c67483-1816-42b5-b44a-f18634fbdef1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:18.074Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f37a57f0-fad2-49ed-849c-4c718e2ce768 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=309 EndTimestamp=2021-07-13T00:58:18.074Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:17.765Z InvocationID=a1db4c5f-2884-4af0-959d-7e8e7b724c17 ResponseDesc=OK 2021-07-13T00:58:18.164Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b4c67483-1816-42b5-b44a-f18634fbdef1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=725 EndTimestamp=2021-07-13T00:58:18.164Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:17.439Z InvocationID=8a3f130d-d76e-44f7-8a61-959f11d908c0 ResponseDesc=OK 2021-07-13T00:58:18.873Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c058468f-4d45-44f8-9b16-7fe761ca094f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:18.873Z InvocationID=ac88f447-d462-41ef-a226-3711f4addaa1 2021-07-13T00:58:18.969Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c058468f-4d45-44f8-9b16-7fe761ca094f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:19.277Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c058468f-4d45-44f8-9b16-7fe761ca094f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=404 EndTimestamp=2021-07-13T00:58:19.277Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:18.873Z InvocationID=0dedf993-6c66-4368-8740-ffe77f3ec27f ResponseDesc=OK 2021-07-13T00:58:21.065Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=47d6c77e-0fa7-42f3-a5cb-6d39f15f34a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:21.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:21.065Z InvocationID=c7e1aec3-4bab-4cf7-9bb1-d6d2475392c0 2021-07-13T00:58:21.367Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=47d6c77e-0fa7-42f3-a5cb-6d39f15f34a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:21.564Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=47d6c77e-0fa7-42f3-a5cb-6d39f15f34a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=499 EndTimestamp=2021-07-13T00:58:21.564Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:21.065Z InvocationID=423d4550-238f-4da3-8c8a-4f5f8fee61f0 ResponseDesc=OK 2021-07-13T00:58:25.264Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=98ab3d7f-ff9f-4cd6-b38c-5ab376d7c12b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:25.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:25.264Z InvocationID=ba1d8c80-d5fa-4cf0-aee4-87958f8547c4 2021-07-13T00:58:25.556Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=98ab3d7f-ff9f-4cd6-b38c-5ab376d7c12b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:25.757Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=98ab3d7f-ff9f-4cd6-b38c-5ab376d7c12b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=493 EndTimestamp=2021-07-13T00:58:25.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:25.264Z InvocationID=f5a09d37-ddb4-4f45-b481-6f7f311c512e ResponseDesc=OK 2021-07-13T00:58:26.763Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=34af281f-8be9-4a23-8b07-7c4c60ea776f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:26.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:26.763Z InvocationID=e18cb787-c657-45b4-8718-29b0d6405209 2021-07-13T00:58:26.860Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=34af281f-8be9-4a23-8b07-7c4c60ea776f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:27.112Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=34af281f-8be9-4a23-8b07-7c4c60ea776f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=349 EndTimestamp=2021-07-13T00:58:27.112Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:26.763Z InvocationID=ade1bc47-df40-49d8-8327-67274260fce8 ResponseDesc=OK 2021-07-13T00:58:27.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2f742c88-f21b-4619-9ae3-4ac674c52f9f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:27.439Z InvocationID=b2bb3797-d3cc-4da0-91cf-f44a48858387 2021-07-13T00:58:27.622Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2f742c88-f21b-4619-9ae3-4ac674c52f9f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:27.861Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2f742c88-f21b-4619-9ae3-4ac674c52f9f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=422 EndTimestamp=2021-07-13T00:58:27.861Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:27.439Z InvocationID=81e6d0e1-ee8a-4755-9e07-980174301000 ResponseDesc=OK 2021-07-13T00:58:28.873Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1f6d96e8-1bdb-4cd8-93f5-388fbe78ad1b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:28.873Z InvocationID=73e883e1-ffb8-4270-af20-b35c00e833cc 2021-07-13T00:58:29.057Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1f6d96e8-1bdb-4cd8-93f5-388fbe78ad1b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:29.466Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1f6d96e8-1bdb-4cd8-93f5-388fbe78ad1b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=593 EndTimestamp=2021-07-13T00:58:29.466Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:28.873Z InvocationID=4575d8bd-e5ea-4634-964c-babf38b00b3d ResponseDesc=OK 2021-07-13T00:58:29.871Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=99e58363-61b3-436d-856c-31e92f780c36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:29.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:29.870Z InvocationID=06e684fb-6704-40f4-934c-3aba9d3d9069 2021-07-13T00:58:29.960Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=99e58363-61b3-436d-856c-31e92f780c36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:30.065Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=99e58363-61b3-436d-856c-31e92f780c36 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=195 EndTimestamp=2021-07-13T00:58:30.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:29.870Z InvocationID=74cea651-ebde-426f-992b-18b161470342 ResponseDesc=OK 2021-07-13T00:58:32.865Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=40ad4321-f9f8-477a-b6e8-f7a0f89d3879 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:32.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:32.865Z InvocationID=170f29fd-276b-4263-88c8-72f7080c9a22 2021-07-13T00:58:33.116Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=40ad4321-f9f8-477a-b6e8-f7a0f89d3879 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:33.360Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=40ad4321-f9f8-477a-b6e8-f7a0f89d3879 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T00:58:33.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:32.865Z InvocationID=d764c04b-2d29-4bb6-bf1d-fe4c753c6fae ResponseDesc=OK 2021-07-13T00:58:35.760Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6c57c97b-e30d-4d33-8e25-994deeff2d55 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:35.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:35.760Z InvocationID=8d1d4861-6166-4029-8a4d-66876e631721 2021-07-13T00:58:35.857Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6c57c97b-e30d-4d33-8e25-994deeff2d55 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:36.157Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6c57c97b-e30d-4d33-8e25-994deeff2d55 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=397 EndTimestamp=2021-07-13T00:58:36.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:35.760Z InvocationID=9f847dec-373a-4a48-b806-9903c08d3971 ResponseDesc=OK 2021-07-13T00:58:37.440Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e1978011-5a55-41f6-a333-d6379ec48fab InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:37.440Z InvocationID=7de0f0aa-e31c-4735-9a32-feea3831f232 2021-07-13T00:58:37.560Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e1978011-5a55-41f6-a333-d6379ec48fab InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:37.929Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e1978011-5a55-41f6-a333-d6379ec48fab InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=489 EndTimestamp=2021-07-13T00:58:37.929Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:37.440Z InvocationID=860f274e-ed96-4401-93cd-bb26f83c9783 ResponseDesc=OK 2021-07-13T00:58:38.579Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a0bb4227-a423-4a38-ba77-5528f6d63bfc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:38.579Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:38.579Z InvocationID=6ec71781-d8b5-4742-9dee-91ca86a5a648 2021-07-13T00:58:38.813Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a0bb4227-a423-4a38-ba77-5528f6d63bfc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:38.874Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0b2fbcb3-0cc0-47b8-8626-7d69e1d2b04a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:38.873Z InvocationID=1f9bd992-ca70-4c84-814a-64c4dddc494a 2021-07-13T00:58:39.056Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0b2fbcb3-0cc0-47b8-8626-7d69e1d2b04a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:39.063Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a0bb4227-a423-4a38-ba77-5528f6d63bfc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=484 EndTimestamp=2021-07-13T00:58:39.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:38.579Z InvocationID=c903d1df-d0d7-46e0-9963-4471a7faff1c ResponseDesc=OK 2021-07-13T00:58:39.461Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0b2fbcb3-0cc0-47b8-8626-7d69e1d2b04a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=588 EndTimestamp=2021-07-13T00:58:39.461Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:38.873Z InvocationID=9bc17134-50fd-45c8-911d-40276c8c1827 ResponseDesc=OK 2021-07-13T00:58:41.823Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=705b9b8f-d9cb-4f34-9cb3-a86c8069efd6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:41.822Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:41.822Z InvocationID=d46a5c0e-8c64-4578-b29b-4e8acbd681a7 2021-07-13T00:58:42.060Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=705b9b8f-d9cb-4f34-9cb3-a86c8069efd6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:42.413Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=705b9b8f-d9cb-4f34-9cb3-a86c8069efd6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=591 EndTimestamp=2021-07-13T00:58:42.413Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:41.822Z InvocationID=c5ac7496-a98b-4d47-baf9-a19a78aa1d6d ResponseDesc=OK 2021-07-13T00:58:44.871Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4f717991-1ebb-47fa-b97b-11aebba3c91f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:44.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:44.871Z InvocationID=7d9f9afd-3e71-4f20-8c8b-f61718f1ce37 2021-07-13T00:58:45.058Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4f717991-1ebb-47fa-b97b-11aebba3c91f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:45.168Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4f717991-1ebb-47fa-b97b-11aebba3c91f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=297 EndTimestamp=2021-07-13T00:58:45.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:44.871Z InvocationID=859b7a89-80e7-4c15-b5d0-3ca1e52dcb3c ResponseDesc=OK 2021-07-13T00:58:47.440Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=763298c9-a017-47b3-aa4b-5940a9eca1c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:47.440Z InvocationID=b3a5d2e6-f577-4409-b4e2-841d4a2308bb 2021-07-13T00:58:47.657Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=763298c9-a017-47b3-aa4b-5940a9eca1c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:47.870Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5f5e3d9-972e-4813-ad18-87cff72d6a44 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:47.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:47.870Z InvocationID=afc6d909-0516-4404-8c37-9b682243a02c 2021-07-13T00:58:48.058Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=763298c9-a017-47b3-aa4b-5940a9eca1c3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=617 EndTimestamp=2021-07-13T00:58:48.057Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:47.440Z InvocationID=c8da72da-4203-4ce6-bf79-71e03e15736b ResponseDesc=OK 2021-07-13T00:58:48.059Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5f5e3d9-972e-4813-ad18-87cff72d6a44 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:48.413Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f5f5e3d9-972e-4813-ad18-87cff72d6a44 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=543 EndTimestamp=2021-07-13T00:58:48.413Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:47.870Z InvocationID=2c003230-8418-4a77-b37e-16d4e72e14d9 ResponseDesc=OK 2021-07-13T00:58:48.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=49fa9aee-6f40-4108-b2cf-cb5004b6cb09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:48.873Z InvocationID=12ffbe9b-551d-42cd-bdea-8f5ce17f0134 2021-07-13T00:58:49.122Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=49fa9aee-6f40-4108-b2cf-cb5004b6cb09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:49.360Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=49fa9aee-6f40-4108-b2cf-cb5004b6cb09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=487 EndTimestamp=2021-07-13T00:58:49.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:48.873Z InvocationID=fbb90584-4b73-443a-98c9-bc0cf36441d4 ResponseDesc=OK 2021-07-13T00:58:50.677Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=417d45d2-7ef3-4677-a04b-0f6e94b28627 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:50.677Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:50.677Z InvocationID=fbdf2002-b83c-4a06-bce5-aabc878847b1 2021-07-13T00:58:50.856Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=417d45d2-7ef3-4677-a04b-0f6e94b28627 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:51.370Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=417d45d2-7ef3-4677-a04b-0f6e94b28627 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=693 EndTimestamp=2021-07-13T00:58:51.370Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:50.677Z InvocationID=c533424b-a4ce-4c5a-811a-08e0d7983fcc ResponseDesc=OK 2021-07-13T00:58:53.677Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7004594a-98a7-4c86-ac60-b5bc2296a17d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:53.677Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:53.677Z InvocationID=0444c732-1da8-434d-ac22-623938e33162 2021-07-13T00:58:53.958Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7004594a-98a7-4c86-ac60-b5bc2296a17d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:54.162Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7004594a-98a7-4c86-ac60-b5bc2296a17d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=484 EndTimestamp=2021-07-13T00:58:54.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:53.677Z InvocationID=8db408fe-2895-4b16-bd7e-2f6ac948816b ResponseDesc=OK 2021-07-13T00:58:56.663Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=677b5905-150f-40ac-9a3e-9684219df848 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:56.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:56.663Z InvocationID=6a7392a7-8509-4dcb-a71b-36feff67dbd1 2021-07-13T00:58:56.926Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=677b5905-150f-40ac-9a3e-9684219df848 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:57.271Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=677b5905-150f-40ac-9a3e-9684219df848 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=608 EndTimestamp=2021-07-13T00:58:57.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:56.663Z InvocationID=393d2f79-4c4b-4787-888e-4d09ab9f75fa ResponseDesc=OK 2021-07-13T00:58:57.438Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=edfa6ae2-6cb5-482e-89b7-ed5b606aae86 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:57.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:57.438Z InvocationID=e1aef47a-37ee-4a6a-a722-a3b0bce08e2b 2021-07-13T00:58:57.656Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=edfa6ae2-6cb5-482e-89b7-ed5b606aae86 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:57.958Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=edfa6ae2-6cb5-482e-89b7-ed5b606aae86 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=519 EndTimestamp=2021-07-13T00:58:57.957Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:57.438Z InvocationID=e741f997-a193-4dec-8ced-878dc5fdaf16 ResponseDesc=OK 2021-07-13T00:58:58.873Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5a315e5e-bd81-4891-81f9-d36a431cdf2a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:58.873Z InvocationID=26eec242-4703-4731-b967-f962bff7dca2 2021-07-13T00:58:59.058Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5a315e5e-bd81-4891-81f9-d36a431cdf2a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:58:59.417Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5a315e5e-bd81-4891-81f9-d36a431cdf2a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=544 EndTimestamp=2021-07-13T00:58:59.417Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:58.873Z InvocationID=3998edfd-fc15-4440-b189-009dc02aeaa1 ResponseDesc=OK 2021-07-13T00:58:59.968Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=68a635f1-3ce3-4167-b63a-eb1173bde60d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:58:59.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:59.968Z InvocationID=305ecfb9-145e-4863-ac23-e7bc0dd775a9 2021-07-13T00:59:00.412Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=68a635f1-3ce3-4167-b63a-eb1173bde60d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:00.860Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=68a635f1-3ce3-4167-b63a-eb1173bde60d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=892 EndTimestamp=2021-07-13T00:59:00.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:58:59.968Z InvocationID=6ca879e1-baf7-42b1-8102-180d007d593e ResponseDesc=OK 2021-07-13T00:59:02.665Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=93e77f1d-aa93-46de-980b-9ad70f73abda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:02.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:02.665Z InvocationID=f0374acf-fa88-4889-9cfc-daeb0e17c1f5 2021-07-13T00:59:02.856Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=93e77f1d-aa93-46de-980b-9ad70f73abda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:03.069Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=93e77f1d-aa93-46de-980b-9ad70f73abda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=404 EndTimestamp=2021-07-13T00:59:03.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:02.665Z InvocationID=9a115027-aa22-461b-818a-0c92f9a0d549 ResponseDesc=OK 2021-07-13T00:59:05.844Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6f72721b-648b-4c80-aadc-b8dd384710de InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:05.844Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:05.844Z InvocationID=2d44572c-8d4c-4bd6-ace2-06d9dff10ccd 2021-07-13T00:59:05.863Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6f72721b-648b-4c80-aadc-b8dd384710de InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:07.439Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f2be2e13-f8c2-45bb-803f-875d48a81e11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:07.439Z InvocationID=97898b20-abdf-423c-afaa-a9d2d1f9b52e 2021-07-13T00:59:08.873Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=656dded0-5a8f-43e4-aeb4-49eca37490bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:08.873Z InvocationID=8d713e49-3235-4f60-8435-6a354e4b831b 2021-07-13T00:59:17.983Z [qtp817348612-69] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=6f72721b-648b-4c80-aadc-b8dd384710de InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:59:17.983Z [qtp817348612-69] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=6f72721b-648b-4c80-aadc-b8dd384710de InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:59:17.985Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=6f72721b-648b-4c80-aadc-b8dd384710de InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=12141 EndTimestamp=2021-07-13T00:59:17.985Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:05.844Z InvocationID=882e60b9-cba9-4456-8d6b-7e3bbd9c5f42 ResponseDesc=Internal Server Error 2021-07-13T00:59:18.881Z [qtp817348612-76] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=656dded0-5a8f-43e4-aeb4-49eca37490bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:59:19.486Z [qtp817348612-75] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f2be2e13-f8c2-45bb-803f-875d48a81e11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:59:22.444Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=22ee489f-7649-4882-8433-f68fda5f3fe5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:22.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:22.444Z InvocationID=761c9057-0a12-4cff-b064-785508a68d0f 2021-07-13T00:59:23.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e0293d67-f519-4a1a-98ce-ba3d3fb08719 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:23.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:23.873Z InvocationID=cd574b74-b9e1-4c96-9720-358b69502990 2021-07-13T00:59:28.916Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8c844fcb-2ee9-4b6a-9138-9e0477c1f1fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:28.916Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:28.916Z InvocationID=fcdc87cc-3c85-46b9-b7ed-f1be1e8ce292 2021-07-13T00:59:28.962Z [qtp817348612-76] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=656dded0-5a8f-43e4-aeb4-49eca37490bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:59:28.970Z [qtp817348612-76] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=656dded0-5a8f-43e4-aeb4-49eca37490bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:59:28.970Z [qtp817348612-76] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=656dded0-5a8f-43e4-aeb4-49eca37490bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:59:28.970Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=656dded0-5a8f-43e4-aeb4-49eca37490bd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=20097 EndTimestamp=2021-07-13T00:59:28.970Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:08.873Z InvocationID=9302ee5c-b6e4-4cb1-bfe6-97f4c0d3550e ResponseDesc=Internal Server Error 2021-07-13T00:59:31.586Z [qtp817348612-75] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f2be2e13-f8c2-45bb-803f-875d48a81e11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T00:59:32.469Z [qtp817348612-51] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=22ee489f-7649-4882-8433-f68fda5f3fe5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:59:32.558Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=22ee489f-7649-4882-8433-f68fda5f3fe5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:59:33.012Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=542d9c47-57eb-47b0-86c9-e77f8bda8775 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T00:59:33.012Z ElapsedTime=0 EndTimestamp=2021-07-13T00:59:33.012Z InvocationID=858cb91f-774c-403a-a82d-1ce799d34f10 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T00:59:33.878Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e0293d67-f519-4a1a-98ce-ba3d3fb08719 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T00:59:34.816Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f2be2e13-f8c2-45bb-803f-875d48a81e11 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=27376 EndTimestamp=2021-07-13T00:59:34.815Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:07.439Z InvocationID=afb2fbed-f340-47b6-8134-00407abd5248 ResponseDesc=Internal Server Error 2021-07-13T00:59:34.816Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=22ee489f-7649-4882-8433-f68fda5f3fe5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=12372 EndTimestamp=2021-07-13T00:59:34.816Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:22.444Z InvocationID=09bf50f7-2431-4bea-8951-25b23912ae7a ResponseDesc=Internal Server Error 2021-07-13T00:59:34.816Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=542d9c47-57eb-47b0-86c9-e77f8bda8775 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:34.816Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8c844fcb-2ee9-4b6a-9138-9e0477c1f1fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:34.819Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a9225b06-78e9-4f28-a5e5-8bceb77cb95f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:34.819Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:34.819Z InvocationID=6478abb3-3c1b-49a2-b07b-0dfd2ab855e7 2021-07-13T00:59:34.960Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=e0293d67-f519-4a1a-98ce-ba3d3fb08719 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=11087 EndTimestamp=2021-07-13T00:59:34.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:23.873Z InvocationID=7524f2cc-3140-4dd7-83fa-8a9b2b0b839d ResponseDesc=Internal Server Error 2021-07-13T00:59:34.963Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=492aaa8c-2993-4291-9c76-e87fd8da3fd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:34.962Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:34.962Z InvocationID=e0cf9c8a-2c6f-48da-8789-92132be31c95 2021-07-13T00:59:35.019Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a9225b06-78e9-4f28-a5e5-8bceb77cb95f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:35.157Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8c844fcb-2ee9-4b6a-9138-9e0477c1f1fc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=6241 EndTimestamp=2021-07-13T00:59:35.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:28.916Z InvocationID=e3fc4cfd-23ed-4a1d-b07f-b294e498a90a ResponseDesc=OK 2021-07-13T00:59:35.173Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=492aaa8c-2993-4291-9c76-e87fd8da3fd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:35.414Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=542d9c47-57eb-47b0-86c9-e77f8bda8775 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2402 EndTimestamp=2021-07-13T00:59:35.414Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:33.012Z InvocationID=0850ed40-f766-4d04-a0cd-87e48760241b ResponseDesc=OK 2021-07-13T00:59:35.460Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a9225b06-78e9-4f28-a5e5-8bceb77cb95f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=641 EndTimestamp=2021-07-13T00:59:35.460Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:34.819Z InvocationID=0f128ef0-b686-410b-a374-e1507c67f1c4 ResponseDesc=OK 2021-07-13T00:59:35.557Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=492aaa8c-2993-4291-9c76-e87fd8da3fd2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=595 EndTimestamp=2021-07-13T00:59:35.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:34.962Z InvocationID=18b0680f-1f64-41e8-92e3-d35f26ab1e3b ResponseDesc=OK 2021-07-13T00:59:36.171Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6016dc01-5390-4417-9597-15bb8739d3cb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:36.171Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:36.171Z InvocationID=1e31e124-694a-4df9-b140-781666e1bc9f 2021-07-13T00:59:36.359Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6016dc01-5390-4417-9597-15bb8739d3cb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:36.716Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6016dc01-5390-4417-9597-15bb8739d3cb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=545 EndTimestamp=2021-07-13T00:59:36.716Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:36.171Z InvocationID=2b7b3987-cf49-4e15-9e58-d6253830e4ab ResponseDesc=OK 2021-07-13T00:59:37.439Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=94fc4a75-a8f0-4937-a254-630b4866faf7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:37.439Z InvocationID=05ee0b84-3a86-4d66-9e2d-842bbbcdeaed 2021-07-13T00:59:37.612Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=94fc4a75-a8f0-4937-a254-630b4866faf7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:37.763Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c571eae1-b7a4-49ae-b330-add8b28c8d6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:37.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:37.763Z InvocationID=07c1226e-ad97-4f33-93e9-daa3d5f6972d 2021-07-13T00:59:37.866Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=94fc4a75-a8f0-4937-a254-630b4866faf7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=427 EndTimestamp=2021-07-13T00:59:37.866Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:37.439Z InvocationID=e0c8dbfe-a9a4-465b-a0a0-d3988b13bf83 ResponseDesc=OK 2021-07-13T00:59:37.957Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c571eae1-b7a4-49ae-b330-add8b28c8d6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:38.257Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c571eae1-b7a4-49ae-b330-add8b28c8d6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=494 EndTimestamp=2021-07-13T00:59:38.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:37.763Z InvocationID=2dd907fe-3fde-4c16-ab1e-1b9f3a5242b4 ResponseDesc=OK 2021-07-13T00:59:38.873Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3fb12d8a-111d-46e1-afcd-d0d2956a7c41 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:38.873Z InvocationID=9b86962f-244f-4504-8715-8e8432d125b3 2021-07-13T00:59:39.063Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3fb12d8a-111d-46e1-afcd-d0d2956a7c41 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:39.519Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=683e767b-d99e-4f0a-ad91-ef392ba54124 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:39.519Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:39.519Z InvocationID=ad460f34-ddfc-4b49-aa4d-d12784f8e54e 2021-07-13T00:59:39.714Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=683e767b-d99e-4f0a-ad91-ef392ba54124 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:39.822Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3fb12d8a-111d-46e1-afcd-d0d2956a7c41 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=949 EndTimestamp=2021-07-13T00:59:39.822Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:38.873Z InvocationID=130de5b1-19e6-4c38-847a-c3e574063bbe ResponseDesc=OK 2021-07-13T00:59:39.959Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=683e767b-d99e-4f0a-ad91-ef392ba54124 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=440 EndTimestamp=2021-07-13T00:59:39.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:39.519Z InvocationID=ee70e782-b68a-4336-a728-d55a55c8980b ResponseDesc=OK 2021-07-13T00:59:41.025Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d47869d8-c07d-4753-bf08-1c35ac1e50af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:41.025Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:41.025Z InvocationID=dc335f92-a6b1-43b6-9c7b-94a10803b60f 2021-07-13T00:59:41.156Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d47869d8-c07d-4753-bf08-1c35ac1e50af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:41.657Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d47869d8-c07d-4753-bf08-1c35ac1e50af InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=632 EndTimestamp=2021-07-13T00:59:41.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:41.025Z InvocationID=83745056-8b90-497a-b18f-3729df7a9ed8 ResponseDesc=OK 2021-07-13T00:59:42.477Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c0ac538a-a0a6-41dd-8d69-4fac964ad9f3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:42.477Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:42.477Z InvocationID=b1659c45-52bf-4faf-b2a6-a8ddf7bf50a5 2021-07-13T00:59:42.659Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c0ac538a-a0a6-41dd-8d69-4fac964ad9f3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:43.020Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c0ac538a-a0a6-41dd-8d69-4fac964ad9f3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=543 EndTimestamp=2021-07-13T00:59:43.020Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:42.477Z InvocationID=b54a52c3-0c25-41bb-83e0-6dc0d5f56179 ResponseDesc=OK 2021-07-13T00:59:43.669Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e9317a27-9cce-4635-85f1-9643013c0a48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:43.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:43.669Z InvocationID=33f2b3ff-e73b-4c50-b672-db548f116868 2021-07-13T00:59:43.935Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e9317a27-9cce-4635-85f1-9643013c0a48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:44.160Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e9317a27-9cce-4635-85f1-9643013c0a48 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=490 EndTimestamp=2021-07-13T00:59:44.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:43.669Z InvocationID=78ccc7ed-8146-461d-a524-4313920f2c19 ResponseDesc=OK 2021-07-13T00:59:45.276Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c84c8663-8ee2-4f41-8fd9-ec518bbb3406 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:45.276Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:45.276Z InvocationID=5dfede86-f3f7-41cb-9734-58a22f86cdf0 2021-07-13T00:59:45.556Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c84c8663-8ee2-4f41-8fd9-ec518bbb3406 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:45.957Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c84c8663-8ee2-4f41-8fd9-ec518bbb3406 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=681 EndTimestamp=2021-07-13T00:59:45.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:45.276Z InvocationID=8c307a69-04db-456f-b3bc-a98902c331b7 ResponseDesc=OK 2021-07-13T00:59:47.372Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=456c1626-b6b5-4126-bce5-6b598a305329 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:47.372Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:47.372Z InvocationID=9bcbb695-da23-418e-bdf4-c0bede1fb106 2021-07-13T00:59:47.439Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e5d13c88-0cdb-45bb-a222-fa773f90549c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:47.439Z InvocationID=6ee1e2f1-d728-4453-82fc-ffa902757924 2021-07-13T00:59:48.873Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=537b1179-a8d4-4e6e-bcd6-c7b9672079d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:48.873Z InvocationID=130dfd85-7d81-4da5-bffb-60677aba710d 2021-07-13T00:59:49.557Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e5d13c88-0cdb-45bb-a222-fa773f90549c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:49.559Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=456c1626-b6b5-4126-bce5-6b598a305329 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:49.716Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=537b1179-a8d4-4e6e-bcd6-c7b9672079d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:49.759Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e5d13c88-0cdb-45bb-a222-fa773f90549c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2320 EndTimestamp=2021-07-13T00:59:49.759Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:47.439Z InvocationID=d99a104f-62c9-47ac-bf6e-c00680b7b932 ResponseDesc=OK 2021-07-13T00:59:50.513Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=456c1626-b6b5-4126-bce5-6b598a305329 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3140 EndTimestamp=2021-07-13T00:59:50.512Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:47.372Z InvocationID=dcc56aa7-df16-41f1-a47c-ed432dd78cfd ResponseDesc=OK 2021-07-13T00:59:50.657Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=537b1179-a8d4-4e6e-bcd6-c7b9672079d5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1784 EndTimestamp=2021-07-13T00:59:50.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:48.873Z InvocationID=98e3f049-f1da-48ee-9a65-27e2a5ee9e0c ResponseDesc=OK 2021-07-13T00:59:51.806Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=009e247a-56c8-4369-93e1-bc60a924975d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:51.806Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:51.806Z InvocationID=0a6c331a-a858-4771-a16a-c3ecd57f8b5f 2021-07-13T00:59:51.970Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=009e247a-56c8-4369-93e1-bc60a924975d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:52.315Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=009e247a-56c8-4369-93e1-bc60a924975d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=509 EndTimestamp=2021-07-13T00:59:52.315Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:51.806Z InvocationID=cc3d3e96-021c-43b5-978b-cb8bea33b0c9 ResponseDesc=OK 2021-07-13T00:59:53.471Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=34f181d0-6f26-4ae0-8617-46e30500d9fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:53.471Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:53.471Z InvocationID=45ce98e0-81b3-466c-b3bd-5bf8790223e6 2021-07-13T00:59:53.726Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=34f181d0-6f26-4ae0-8617-46e30500d9fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:54.060Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=34f181d0-6f26-4ae0-8617-46e30500d9fd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=589 EndTimestamp=2021-07-13T00:59:54.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:53.471Z InvocationID=d5b990f2-972d-4947-985a-59c4c94ded38 ResponseDesc=OK 2021-07-13T00:59:55.218Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ec71dae1-f288-481f-bda9-a4fa6feb6a33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:55.218Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:55.218Z InvocationID=675c45f4-f554-4d4a-b9a5-620ff1854e47 2021-07-13T00:59:55.357Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ec71dae1-f288-481f-bda9-a4fa6feb6a33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:55.757Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ec71dae1-f288-481f-bda9-a4fa6feb6a33 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=539 EndTimestamp=2021-07-13T00:59:55.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:55.218Z InvocationID=c76ff3a7-1c79-4a69-a11d-500cf454b09b ResponseDesc=OK 2021-07-13T00:59:56.878Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=555f19b8-d3eb-4d63-a003-d764af9f4cc7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:56.878Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:56.878Z InvocationID=e29d29d1-6829-4686-a8de-9ce8b90f4287 2021-07-13T00:59:57.159Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=555f19b8-d3eb-4d63-a003-d764af9f4cc7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:57.438Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4e563254-2768-45de-8754-ede338055983 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:57.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:57.438Z InvocationID=208fe990-dd73-47d8-9947-6d47c61bff4c 2021-07-13T00:59:57.511Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=555f19b8-d3eb-4d63-a003-d764af9f4cc7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=633 EndTimestamp=2021-07-13T00:59:57.511Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:56.878Z InvocationID=a700c208-cf58-444d-a46a-1a13597a412f ResponseDesc=OK 2021-07-13T00:59:57.711Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4e563254-2768-45de-8754-ede338055983 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:57.962Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4e563254-2768-45de-8754-ede338055983 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=524 EndTimestamp=2021-07-13T00:59:57.962Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:57.438Z InvocationID=04746bdf-21e6-4a17-84ff-a17472698b75 ResponseDesc=OK 2021-07-13T00:59:58.821Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=837576f7-99e5-4a86-b7ac-b5d9e3f03d09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:58.821Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:58.821Z InvocationID=5207e4b2-4287-4826-bec5-f498a3fd3d0f 2021-07-13T00:59:58.873Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=010c39d6-83ba-424c-8e5c-202a416d590a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T00:59:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:58.873Z InvocationID=27dd4588-a54c-4aee-a42e-fa60054d7693 2021-07-13T00:59:58.957Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=837576f7-99e5-4a86-b7ac-b5d9e3f03d09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:59.117Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=010c39d6-83ba-424c-8e5c-202a416d590a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T00:59:59.260Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=837576f7-99e5-4a86-b7ac-b5d9e3f03d09 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=439 EndTimestamp=2021-07-13T00:59:59.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:58.821Z InvocationID=c00e3454-48fb-4026-986c-b0e5e44c2bdb ResponseDesc=OK 2021-07-13T01:00:00.332Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=010c39d6-83ba-424c-8e5c-202a416d590a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1459 EndTimestamp=2021-07-13T01:00:00.332Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T00:59:58.873Z InvocationID=6a164bd8-6d21-45fa-ba9a-38ebb1f7f4dc ResponseDesc=OK 2021-07-13T01:00:00.562Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e2211338-ad76-4e3e-92b9-ebacdbd83790 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:00.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:00.562Z InvocationID=2eeb307f-b646-41c0-b7da-414a5f86975b 2021-07-13T01:00:00.837Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e2211338-ad76-4e3e-92b9-ebacdbd83790 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:01.059Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e2211338-ad76-4e3e-92b9-ebacdbd83790 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=497 EndTimestamp=2021-07-13T01:00:01.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:00.562Z InvocationID=a5ec9900-0dfb-4a0e-be43-6b0452e8d68f ResponseDesc=OK 2021-07-13T01:00:02.163Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3bfe1c9f-e0fb-41f2-bc1c-58c330439d73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:02.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:02.163Z InvocationID=6031ef76-c795-4ee9-97bb-0bf454c5b7a1 2021-07-13T01:00:03.357Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3bfe1c9f-e0fb-41f2-bc1c-58c330439d73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:03.861Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3bfe1c9f-e0fb-41f2-bc1c-58c330439d73 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1698 EndTimestamp=2021-07-13T01:00:03.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:02.163Z InvocationID=2a0275fb-df83-4ba1-ad98-5c7a3aa7b81e ResponseDesc=OK 2021-07-13T01:00:05.024Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=43af5460-da1e-46c5-bc23-fbe41a4b894c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:05.024Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:05.024Z InvocationID=4939b996-5464-4152-ba71-e4c8a6d11445 2021-07-13T01:00:05.167Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=43af5460-da1e-46c5-bc23-fbe41a4b894c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:05.419Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=43af5460-da1e-46c5-bc23-fbe41a4b894c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=395 EndTimestamp=2021-07-13T01:00:05.419Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:05.024Z InvocationID=755ed4fe-19a4-406e-8921-9119ccf2fadf ResponseDesc=OK 2021-07-13T01:00:06.372Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6469427a-f439-40c1-8d6b-b12678b2d1a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:06.371Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:06.371Z InvocationID=0b36c90d-c4d4-4e68-9630-ec716167cfcb 2021-07-13T01:00:06.612Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6469427a-f439-40c1-8d6b-b12678b2d1a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:06.859Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6469427a-f439-40c1-8d6b-b12678b2d1a2 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=488 EndTimestamp=2021-07-13T01:00:06.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:06.371Z InvocationID=2c6ade31-ad6f-4005-b887-f4b98e5947b7 ResponseDesc=OK 2021-07-13T01:00:07.439Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f92015bd-422f-4f61-a082-7c5c68ab7f9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:07.439Z InvocationID=5bbfbf95-b67e-402e-9968-3e3f229b9b94 2021-07-13T01:00:07.557Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f92015bd-422f-4f61-a082-7c5c68ab7f9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:07.769Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a10805e8-7f1a-4a13-9299-004829e848e7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:07.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:07.769Z InvocationID=1a7b1ecd-b88a-4497-ae9a-c7e2bc2c25e4 2021-07-13T01:00:07.957Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f92015bd-422f-4f61-a082-7c5c68ab7f9d InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=518 EndTimestamp=2021-07-13T01:00:07.957Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:07.439Z InvocationID=fc671228-c8d6-4d9b-9a3a-b106b703b90e ResponseDesc=OK 2021-07-13T01:00:07.958Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a10805e8-7f1a-4a13-9299-004829e848e7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:08.211Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a10805e8-7f1a-4a13-9299-004829e848e7 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=442 EndTimestamp=2021-07-13T01:00:08.211Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:07.769Z InvocationID=a04a8d6c-eb34-4ad5-bb0b-16ef1d4f8774 ResponseDesc=OK 2021-07-13T01:00:08.874Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5ffefa33-36ef-447c-9418-3ab26d880b04 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:08.874Z InvocationID=76e7f629-b12f-45c9-b9ca-78c1355fe1fe 2021-07-13T01:00:09.011Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5ffefa33-36ef-447c-9418-3ab26d880b04 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:09.358Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5ffefa33-36ef-447c-9418-3ab26d880b04 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=484 EndTimestamp=2021-07-13T01:00:09.358Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:08.874Z InvocationID=d939f2bf-d7c0-407e-ba95-b0fc6d6d68cb ResponseDesc=OK 2021-07-13T01:00:09.361Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=976b0f64-b1cc-411b-a0c7-7a0bd024707f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:09.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:09.361Z InvocationID=d76c7029-f905-406c-9efe-d1f586e942b9 2021-07-13T01:00:09.557Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=976b0f64-b1cc-411b-a0c7-7a0bd024707f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:10.057Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=976b0f64-b1cc-411b-a0c7-7a0bd024707f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=696 EndTimestamp=2021-07-13T01:00:10.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:09.361Z InvocationID=68367a8a-ae96-46e6-8a0f-b06dc656ad4d ResponseDesc=OK 2021-07-13T01:00:11.667Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c929348d-565c-4908-9ac7-6e6bbe8560fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:11.667Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:11.667Z InvocationID=42d1dc86-d5cd-4302-bd9c-85306399f45e 2021-07-13T01:00:11.815Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c929348d-565c-4908-9ac7-6e6bbe8560fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:12.319Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c929348d-565c-4908-9ac7-6e6bbe8560fb InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=652 EndTimestamp=2021-07-13T01:00:12.319Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:11.667Z InvocationID=04749857-7520-4676-b5a1-49fa1971ef0a ResponseDesc=OK 2021-07-13T01:00:14.774Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4aef3ef8-b720-43cd-805a-bef84782fe32 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:14.774Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:14.774Z InvocationID=66f7803b-5bc4-452f-ad55-c602bb823f6a 2021-07-13T01:00:15.019Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4aef3ef8-b720-43cd-805a-bef84782fe32 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:15.359Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4aef3ef8-b720-43cd-805a-bef84782fe32 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=585 EndTimestamp=2021-07-13T01:00:15.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:14.774Z InvocationID=de701ee6-db84-4507-b171-275710b68f29 ResponseDesc=OK 2021-07-13T01:00:17.439Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=05ed1201-f058-4215-8b75-faac3382f85a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:17.439Z InvocationID=0bfad297-4ab3-4727-8371-b52102ee14e6 2021-07-13T01:00:17.558Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=05ed1201-f058-4215-8b75-faac3382f85a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:17.774Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9eaab8c8-aba0-4127-884c-d2c08872ba1e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:17.774Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:17.774Z InvocationID=bd0abb81-9055-4142-a288-ba70b60d6a6a 2021-07-13T01:00:17.959Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9eaab8c8-aba0-4127-884c-d2c08872ba1e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:18.557Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9eaab8c8-aba0-4127-884c-d2c08872ba1e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=783 EndTimestamp=2021-07-13T01:00:18.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:17.774Z InvocationID=d454ad64-ee5d-480c-9298-2a8ab0a487d6 ResponseDesc=OK 2021-07-13T01:00:18.714Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=05ed1201-f058-4215-8b75-faac3382f85a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1275 EndTimestamp=2021-07-13T01:00:18.714Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:17.439Z InvocationID=4a8ec997-1200-43ba-835d-dd0ae89ea332 ResponseDesc=OK 2021-07-13T01:00:18.874Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=180cb8d2-f4e5-4efe-8439-24edaadf57d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:18.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:18.873Z InvocationID=c933e54c-db2d-4b67-91d4-071d8387479a 2021-07-13T01:00:19.910Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=180cb8d2-f4e5-4efe-8439-24edaadf57d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:20.263Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=180cb8d2-f4e5-4efe-8439-24edaadf57d0 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1390 EndTimestamp=2021-07-13T01:00:20.263Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:18.873Z InvocationID=5b02beb1-7086-4af9-b70e-1716c36c5511 ResponseDesc=OK 2021-07-13T01:00:20.964Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4d99694b-15ca-40ff-8f06-b230a9427c4f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:20.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:20.964Z InvocationID=c9b7d617-85a0-4676-84da-45ee0179d890 2021-07-13T01:00:21.057Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4d99694b-15ca-40ff-8f06-b230a9427c4f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:21.357Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4d99694b-15ca-40ff-8f06-b230a9427c4f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=393 EndTimestamp=2021-07-13T01:00:21.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:20.964Z InvocationID=999b253c-033b-4ab7-ab24-243e90055e51 ResponseDesc=OK 2021-07-13T01:00:24.068Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c0a1f8ec-7d8d-4d8a-a430-ea406a7f6ffd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:24.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:24.067Z InvocationID=01032562-6502-4b69-9de2-8a33e7eb11d8 2021-07-13T01:00:24.261Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c0a1f8ec-7d8d-4d8a-a430-ea406a7f6ffd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:24.624Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c0a1f8ec-7d8d-4d8a-a430-ea406a7f6ffd InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=557 EndTimestamp=2021-07-13T01:00:24.624Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:24.067Z InvocationID=164f1dfe-64ac-4f1a-a312-71a5bea62e14 ResponseDesc=OK 2021-07-13T01:00:26.717Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7d2b9964-d5df-4563-a0fb-cdcb1e3bdead InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:26.717Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:26.717Z InvocationID=6227ee50-29ff-4e9c-b20e-e7fe56075d3c 2021-07-13T01:00:27.411Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7d2b9964-d5df-4563-a0fb-cdcb1e3bdead InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:27.438Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8b9c4f3f-e496-4090-bbf6-370b4494d85e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:27.438Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:27.438Z InvocationID=fe12f45d-ae3d-4b34-8d4e-950892adcf9d 2021-07-13T01:00:27.557Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8b9c4f3f-e496-4090-bbf6-370b4494d85e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:27.660Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7d2b9964-d5df-4563-a0fb-cdcb1e3bdead InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=943 EndTimestamp=2021-07-13T01:00:27.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:26.717Z InvocationID=6ac44908-037d-41be-80c1-0c038fcb556f ResponseDesc=OK 2021-07-13T01:00:27.964Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8b9c4f3f-e496-4090-bbf6-370b4494d85e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=525 EndTimestamp=2021-07-13T01:00:27.963Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:27.438Z InvocationID=4e1a152c-b199-4b40-a286-1c59316cb634 ResponseDesc=OK 2021-07-13T01:00:28.875Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=628d776a-dd57-4925-b553-e114c7704200 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:28.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:28.875Z InvocationID=795ce666-9da4-4209-ad62-fb13f81e8273 2021-07-13T01:00:29.260Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=628d776a-dd57-4925-b553-e114c7704200 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:29.611Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=628d776a-dd57-4925-b553-e114c7704200 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=736 EndTimestamp=2021-07-13T01:00:29.611Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:28.875Z InvocationID=8be41e77-3329-4b2b-b0c4-502d6d5ed31d ResponseDesc=OK 2021-07-13T01:00:30.371Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a75f38fe-9abf-4082-9c6c-9a875a5ee07c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:30.371Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:30.371Z InvocationID=a3597503-f66c-4445-a5a1-40a24307923f 2021-07-13T01:00:31.267Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a75f38fe-9abf-4082-9c6c-9a875a5ee07c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:31.461Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a75f38fe-9abf-4082-9c6c-9a875a5ee07c InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1090 EndTimestamp=2021-07-13T01:00:31.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:30.371Z InvocationID=46be0fad-b91d-4b60-b264-38dd330b3846 ResponseDesc=OK 2021-07-13T01:00:32.877Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1da2a7c8-6404-495c-9bfd-e8b502752c79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:32.877Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:32.877Z InvocationID=62e91795-cc0c-4caa-b881-ff29619f11d4 2021-07-13T01:00:33.057Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1da2a7c8-6404-495c-9bfd-e8b502752c79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:33.858Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1da2a7c8-6404-495c-9bfd-e8b502752c79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=981 EndTimestamp=2021-07-13T01:00:33.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:32.877Z InvocationID=0bcdbaca-7a40-410b-867a-67a82ecad7e3 ResponseDesc=OK 2021-07-13T01:00:35.770Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b5bf67b6-80a9-4fc3-99cf-6e25c75fa453 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:35.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:35.770Z InvocationID=2e1d618c-732a-4a12-aecb-00738895ba3f 2021-07-13T01:00:35.859Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b5bf67b6-80a9-4fc3-99cf-6e25c75fa453 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:36.224Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b5bf67b6-80a9-4fc3-99cf-6e25c75fa453 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=453 EndTimestamp=2021-07-13T01:00:36.223Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:35.770Z InvocationID=55b26d98-767f-4157-a311-7df9a9a03da3 ResponseDesc=OK 2021-07-13T01:00:37.454Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dc8ab2b3-5ceb-4388-9995-b60916cc4dc1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:37.454Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:37.454Z InvocationID=496fb60e-eca2-4f87-81ab-6b7c2c0aeeac 2021-07-13T01:00:38.110Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dc8ab2b3-5ceb-4388-9995-b60916cc4dc1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:38.271Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dc8ab2b3-5ceb-4388-9995-b60916cc4dc1 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=817 EndTimestamp=2021-07-13T01:00:38.271Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:37.454Z InvocationID=2267795d-e18b-4388-bf82-e697b82fdd48 ResponseDesc=OK 2021-07-13T01:00:38.761Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81222847-ae0c-42fa-971e-41de843f37b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:38.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:38.761Z InvocationID=b84a7271-e26d-4945-b6cc-bd3540ce876c 2021-07-13T01:00:38.874Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=486372ee-d4ca-4cd2-8aba-5e3ad0a803ba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:38.874Z InvocationID=ad67769e-3496-4973-bb88-014c0035d999 2021-07-13T01:00:38.957Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81222847-ae0c-42fa-971e-41de843f37b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:39.117Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=486372ee-d4ca-4cd2-8aba-5e3ad0a803ba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:39.257Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=81222847-ae0c-42fa-971e-41de843f37b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=496 EndTimestamp=2021-07-13T01:00:39.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:38.761Z InvocationID=7c686122-1861-4769-802a-d69eb6d94863 ResponseDesc=OK 2021-07-13T01:00:39.626Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=486372ee-d4ca-4cd2-8aba-5e3ad0a803ba InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=752 EndTimestamp=2021-07-13T01:00:39.626Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:38.874Z InvocationID=0c64277b-675b-485b-8c5e-7209b0431d2e ResponseDesc=OK 2021-07-13T01:00:41.773Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=293525ee-b95b-4f81-aab1-52f3b4e03b38 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:41.773Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:41.773Z InvocationID=cf8f501a-fc7a-4f34-bc40-bb708eeb0839 2021-07-13T01:00:43.118Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=293525ee-b95b-4f81-aab1-52f3b4e03b38 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:43.359Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=293525ee-b95b-4f81-aab1-52f3b4e03b38 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1586 EndTimestamp=2021-07-13T01:00:43.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:41.773Z InvocationID=9d04a2db-4f48-4a4e-be40-59450ebdf7d2 ResponseDesc=OK 2021-07-13T01:00:44.926Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7c32e05d-e345-4155-898b-dbfe014e68b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:44.926Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:44.926Z InvocationID=59763b3d-4f4c-4f17-95e5-c75264f87ba1 2021-07-13T01:00:45.072Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7c32e05d-e345-4155-898b-dbfe014e68b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:45.457Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7c32e05d-e345-4155-898b-dbfe014e68b3 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=531 EndTimestamp=2021-07-13T01:00:45.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:44.926Z InvocationID=a6200d36-98a3-407b-a5f7-9f7b8beaa27c ResponseDesc=OK 2021-07-13T01:00:47.441Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7906e14d-4eb6-4267-9bf9-7aad49526bda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:47.440Z InvocationID=3c60e163-c4de-4c8a-9d7d-174c25ebb6ac 2021-07-13T01:00:47.563Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7906e14d-4eb6-4267-9bf9-7aad49526bda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:47.965Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f2aadc74-4d1a-485d-9ef6-6c71b5938a6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:47.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:47.965Z InvocationID=d6eba5ba-b097-4e74-8ba9-6e0d9ed87356 2021-07-13T01:00:48.872Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f62683d7-9828-4ed1-81f4-ddb533d19ac6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:48.872Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:48.872Z InvocationID=728791bb-3dce-4828-99c8-0bb5f2771f47 2021-07-13T01:00:53.061Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f62683d7-9828-4ed1-81f4-ddb533d19ac6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:53.668Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f62683d7-9828-4ed1-81f4-ddb533d19ac6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4796 EndTimestamp=2021-07-13T01:00:53.668Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:48.872Z InvocationID=903c9311-6fd6-45e7-8ec8-1e161c6359ab ResponseDesc=OK 2021-07-13T01:00:53.815Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f2aadc74-4d1a-485d-9ef6-6c71b5938a6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:54.174Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b861784a-c93b-41be-a6a3-7adaa1469a40 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:54.174Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:54.174Z InvocationID=3bb871e0-b6f9-444f-b815-602e62ffb5ca 2021-07-13T01:00:54.363Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b861784a-c93b-41be-a6a3-7adaa1469a40 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:57.481Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b861784a-c93b-41be-a6a3-7adaa1469a40 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=3307 EndTimestamp=2021-07-13T01:00:57.481Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:54.174Z InvocationID=54b01249-dfb2-4ec1-8e99-38ea2f2eec72 ResponseDesc=OK 2021-07-13T01:00:57.524Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f2aadc74-4d1a-485d-9ef6-6c71b5938a6e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=9559 EndTimestamp=2021-07-13T01:00:57.524Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:47.965Z InvocationID=329d9efe-41d4-4e2d-831e-58df8459e6a7 ResponseDesc=OK 2021-07-13T01:00:57.783Z [qtp817348612-75] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=7906e14d-4eb6-4267-9bf9-7aad49526bda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureCassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:00:57.783Z [qtp817348612-75] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7906e14d-4eb6-4267-9bf9-7aad49526bda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:00:57.784Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=7906e14d-4eb6-4267-9bf9-7aad49526bda InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=10344 EndTimestamp=2021-07-13T01:00:57.784Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:47.440Z InvocationID=d9a26038-b1a6-4c5e-b500-852e7a106c2c ResponseDesc=Internal Server Error 2021-07-13T01:00:57.791Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5f196cd3-adc4-4e43-8381-7575b83db472 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:57.790Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:57.790Z InvocationID=cc721f66-77af-4943-96f2-1aee784aaa3d 2021-07-13T01:00:58.874Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=724f4a18-e5d2-479e-ba32-d255b273a24f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:58.874Z InvocationID=3158ad6c-5478-468f-a987-346669892ad1 2021-07-13T01:00:59.019Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5f196cd3-adc4-4e43-8381-7575b83db472 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:59.059Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=724f4a18-e5d2-479e-ba32-d255b273a24f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:59.063Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5c0fd611-51c0-470d-bde3-26990a23fdca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:00:59.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:59.062Z InvocationID=f9ee92fc-81c0-4ffb-92e5-6351b9ca024c 2021-07-13T01:00:59.162Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5c0fd611-51c0-470d-bde3-26990a23fdca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:00:59.465Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5f196cd3-adc4-4e43-8381-7575b83db472 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1675 EndTimestamp=2021-07-13T01:00:59.465Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:57.790Z InvocationID=f3620dc7-728d-4695-9b0b-bc5e957d034e ResponseDesc=OK 2021-07-13T01:00:59.558Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=724f4a18-e5d2-479e-ba32-d255b273a24f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=684 EndTimestamp=2021-07-13T01:00:59.558Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:58.874Z InvocationID=68b20cff-a3fe-4f7b-887a-9b8fee97d3bc ResponseDesc=OK 2021-07-13T01:00:59.818Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5c0fd611-51c0-470d-bde3-26990a23fdca InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=756 EndTimestamp=2021-07-13T01:00:59.818Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:00:59.062Z InvocationID=837406d8-8e77-49d9-b39f-178329b06a02 ResponseDesc=OK 2021-07-13T01:01:00.629Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d193d84d-427e-4a4c-9c2a-1a9937013513 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:00.629Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:00.629Z InvocationID=2d6c3824-ba73-4d66-9f21-75ba53f65563 2021-07-13T01:01:01.610Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d193d84d-427e-4a4c-9c2a-1a9937013513 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:01.959Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d193d84d-427e-4a4c-9c2a-1a9937013513 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=1330 EndTimestamp=2021-07-13T01:01:01.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:00.629Z InvocationID=f92001ff-c195-4ca9-a705-69367a1faed9 ResponseDesc=OK 2021-07-13T01:01:02.962Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=03ce8502-a30c-485a-a4e0-b4364979a984 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:02.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:02.962Z InvocationID=29dbd5fa-1bb9-416b-8a62-b544abcb8215 2021-07-13T01:01:03.063Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=03ce8502-a30c-485a-a4e0-b4364979a984 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:03.457Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=03ce8502-a30c-485a-a4e0-b4364979a984 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=495 EndTimestamp=2021-07-13T01:01:03.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:02.962Z InvocationID=ddfb2ec0-5114-48b8-9a4e-8ed43ba4ede1 ResponseDesc=OK 2021-07-13T01:01:04.462Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9467687b-1ff8-4287-a9fe-554df3355682 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:04.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:04.462Z InvocationID=7ec36ba5-2b42-4272-9523-0f937f479387 2021-07-13T01:01:04.559Z [qtp817348612-77] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9467687b-1ff8-4287-a9fe-554df3355682 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:04.776Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9467687b-1ff8-4287-a9fe-554df3355682 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=314 EndTimestamp=2021-07-13T01:01:04.776Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:04.462Z InvocationID=c0feef28-3017-4ec3-9728-e6890f388d6e ResponseDesc=OK 2021-07-13T01:01:05.970Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b1bef8ac-a1c8-412b-a4e7-9c12d2f49c01 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:05.970Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:05.970Z InvocationID=f1e65039-f3c1-4dcc-85ef-92d4bfc7bc42 2021-07-13T01:01:06.226Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b1bef8ac-a1c8-412b-a4e7-9c12d2f49c01 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:06.463Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b1bef8ac-a1c8-412b-a4e7-9c12d2f49c01 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=493 EndTimestamp=2021-07-13T01:01:06.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:05.970Z InvocationID=1c5bbb95-6ff0-436b-a118-c728c10d22f1 ResponseDesc=OK 2021-07-13T01:01:07.439Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e9bcd224-461b-4ef2-89bc-4fc66cf20be5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:07.439Z InvocationID=e0957d76-03a0-4275-b5fa-16ee727b0136 2021-07-13T01:01:07.559Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e9bcd224-461b-4ef2-89bc-4fc66cf20be5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:07.864Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e9bcd224-461b-4ef2-89bc-4fc66cf20be5 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=425 EndTimestamp=2021-07-13T01:01:07.864Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:07.439Z InvocationID=142c72e4-894d-4d81-8c4f-aab08674a52d ResponseDesc=OK 2021-07-13T01:01:08.875Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=24bc845f-e0fd-4bda-b022-0091171dfe1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:08.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:08.875Z InvocationID=ea369633-0b3c-4e20-bd97-8e073421d6d2 2021-07-13T01:01:09.059Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=24bc845f-e0fd-4bda-b022-0091171dfe1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:09.072Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a28ff6c2-8e0d-42b7-9681-d7c937bce473 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:09.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:09.071Z InvocationID=1eab4f61-1a70-4736-8354-e18199498685 2021-07-13T01:01:09.317Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a28ff6c2-8e0d-42b7-9681-d7c937bce473 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:09.714Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a28ff6c2-8e0d-42b7-9681-d7c937bce473 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=643 EndTimestamp=2021-07-13T01:01:09.714Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:09.071Z InvocationID=de3ee3bd-6058-4ff1-a984-693ed517e8a4 ResponseDesc=OK 2021-07-13T01:01:09.815Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=24bc845f-e0fd-4bda-b022-0091171dfe1f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=940 EndTimestamp=2021-07-13T01:01:09.815Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:08.875Z InvocationID=9e020211-551f-4a93-9023-0e61048b9880 ResponseDesc=OK 2021-07-13T01:01:11.927Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a2a63d51-5fcb-4b6b-a89b-93d7d1956e47 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:11.926Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:11.926Z InvocationID=de32ee8f-7091-4037-ad9e-ffa8ae5f815e 2021-07-13T01:01:12.057Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a2a63d51-5fcb-4b6b-a89b-93d7d1956e47 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:12.357Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a2a63d51-5fcb-4b6b-a89b-93d7d1956e47 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=431 EndTimestamp=2021-07-13T01:01:12.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:11.926Z InvocationID=ce910541-3b54-4b16-89a5-038ced39f315 ResponseDesc=OK 2021-07-13T01:01:15.169Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ef539dc6-e0a1-4758-b37e-612a7bd93de9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:15.169Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:15.169Z InvocationID=62c7a7c0-5159-4379-a6d5-bc3552c67dc1 2021-07-13T01:01:15.359Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ef539dc6-e0a1-4758-b37e-612a7bd93de9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:15.760Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ef539dc6-e0a1-4758-b37e-612a7bd93de9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=590 EndTimestamp=2021-07-13T01:01:15.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:15.169Z InvocationID=0722c1e7-1f49-4728-8a47-ce2d545d7610 ResponseDesc=OK 2021-07-13T01:01:17.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1812a99a-6063-4bd0-912e-c6d3f165dbf6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:17.439Z InvocationID=c2eb6c94-575b-47ef-9157-78240c4540c9 2021-07-13T01:01:17.613Z [qtp817348612-71] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1812a99a-6063-4bd0-912e-c6d3f165dbf6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:17.859Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1812a99a-6063-4bd0-912e-c6d3f165dbf6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=420 EndTimestamp=2021-07-13T01:01:17.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:17.439Z InvocationID=e8f5e615-4165-4262-b168-64e54faded9f ResponseDesc=OK 2021-07-13T01:01:18.162Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f0f81713-c724-403b-bf92-68af3fa17226 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:18.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:18.162Z InvocationID=0c795e68-42b2-4a24-b57f-af804de4610e 2021-07-13T01:01:18.357Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f0f81713-c724-403b-bf92-68af3fa17226 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:01:18.874Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=15989cdc-b348-4f4b-84c3-5502b9f57d79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:18.874Z InvocationID=2c56a708-637a-4c39-af10-4622f28218bd 2021-07-13T01:01:27.439Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7ef0db16-d1f8-4b32-880b-555473b7adb8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:27.439Z InvocationID=0ab0fa46-06b2-4341-9d6d-815562814322 2021-07-13T01:01:28.882Z [qtp817348612-77] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=15989cdc-b348-4f4b-84c3-5502b9f57d79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:30.386Z [qtp817348612-81] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f0f81713-c724-403b-bf92-68af3fa17226 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:33.880Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3a822361-2f47-4630-8721-2327139fcabc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:33.880Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:33.880Z InvocationID=04092be3-8232-4311-846d-84c77e6bd0cd 2021-07-13T01:01:37.460Z [qtp817348612-76] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7ef0db16-d1f8-4b32-880b-555473b7adb8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:40.459Z [qtp817348612-81] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=f0f81713-c724-403b-bf92-68af3fa17226 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureCassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:40.459Z [qtp817348612-81] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=f0f81713-c724-403b-bf92-68af3fa17226 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:40.459Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f0f81713-c724-403b-bf92-68af3fa17226 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=22297 EndTimestamp=2021-07-13T01:01:40.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:18.162Z InvocationID=64d1cb9a-3e9c-4e90-b4d0-ed966e0a84e0 ResponseDesc=Internal Server Error 2021-07-13T01:01:40.886Z [qtp817348612-77] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=15989cdc-b348-4f4b-84c3-5502b9f57d79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:41.307Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7305e9b6-449b-4db3-a13d-06454e821348 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:41.307Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:41.307Z InvocationID=a69d71b3-e7bf-4755-b003-b6c286116236 2021-07-13T01:01:42.440Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=55b01eca-1da2-40e8-baa1-40eda620a104 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:42.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:42.440Z InvocationID=71d47fe4-a29c-4111-9c1a-572274bfcfde 2021-07-13T01:01:42.470Z [qtp817348612-51] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=55b01eca-1da2-40e8-baa1-40eda620a104 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:43.884Z [qtp817348612-74] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3a822361-2f47-4630-8721-2327139fcabc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:45.503Z [qtp817348612-84] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e6cb8c5a-eab9-4b5e-8bb7-4bf9bf245c1a ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T01:01:45.503Z ElapsedTime=0 EndTimestamp=2021-07-13T01:01:45.503Z InvocationID=02525397-5754-4719-b98c-3d361c400ecb PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:01:45.573Z [qtp817348612-84] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e6cb8c5a-eab9-4b5e-8bb7-4bf9bf245c1a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:48.876Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d3d4d6ef-740c-4bf3-8057-8a7765e3e20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:48.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:48.876Z InvocationID=e1a8d0a8-73e7-40e6-bade-541781951f7a 2021-07-13T01:01:49.486Z [qtp817348612-76] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7ef0db16-d1f8-4b32-880b-555473b7adb8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:49.562Z [qtp817348612-76] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=7ef0db16-d1f8-4b32-880b-555473b7adb8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:49.562Z [qtp817348612-76] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7ef0db16-d1f8-4b32-880b-555473b7adb8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:49.563Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=7ef0db16-d1f8-4b32-880b-555473b7adb8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=22124 EndTimestamp=2021-07-13T01:01:49.563Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:27.439Z InvocationID=de9993e0-e88b-4ccf-87ca-79e9808d4c61 ResponseDesc=Internal Server Error 2021-07-13T01:01:49.698Z [qtp817348612-86] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a210a798-9e37-47a8-88a0-d71006e99e65 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T01:01:49.698Z ElapsedTime=0 EndTimestamp=2021-07-13T01:01:49.698Z InvocationID=09943d59-d9c6-4ca2-a0c0-5431dd94c442 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:01:49.763Z [qtp817348612-86] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a210a798-9e37-47a8-88a0-d71006e99e65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:52.980Z [qtp817348612-77] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=15989cdc-b348-4f4b-84c3-5502b9f57d79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:52.980Z [qtp817348612-77] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=15989cdc-b348-4f4b-84c3-5502b9f57d79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:52.981Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=15989cdc-b348-4f4b-84c3-5502b9f57d79 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=34107 EndTimestamp=2021-07-13T01:01:52.981Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:18.874Z InvocationID=155dcf53-5d32-420f-b637-590c2bf810ca ResponseDesc=Internal Server Error 2021-07-13T01:01:53.393Z [qtp817348612-69] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7305e9b6-449b-4db3-a13d-06454e821348 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:53.601Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0daebbc8-32eb-48a2-b8ec-13cfed5ea8f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:53.601Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:53.601Z InvocationID=2e9f76ae-a946-4f80-a0c1-b7023f226c99 2021-07-13T01:01:53.661Z [qtp817348612-77] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0daebbc8-32eb-48a2-b8ec-13cfed5ea8f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:54.585Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=55b01eca-1da2-40e8-baa1-40eda620a104 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:55.986Z [qtp817348612-74] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3a822361-2f47-4630-8721-2327139fcabc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:57.439Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ac5e44f9-e66a-4e35-8d64-97328b2ce34b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:57.439Z InvocationID=d38a9310-744c-4110-9c27-537b573eb45f 2021-07-13T01:01:57.608Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=09ed9d23-03fd-45ac-8dff-4cb47b658e30 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:57.608Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:57.608Z InvocationID=27285a07-50fe-49b6-87df-6314887e470b 2021-07-13T01:01:57.685Z [qtp817348612-84] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e6cb8c5a-eab9-4b5e-8bb7-4bf9bf245c1a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:43) at com.datastax.driver.core.exceptions.OperationTimedOutException.copy(OperationTimedOutException.java:25) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.199.132:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:973) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:57.756Z [qtp817348612-81] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=09ed9d23-03fd-45ac-8dff-4cb47b658e30 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:57.759Z [qtp817348612-84] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=e6cb8c5a-eab9-4b5e-8bb7-4bf9bf245c1a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:57.759Z [qtp817348612-84] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e6cb8c5a-eab9-4b5e-8bb7-4bf9bf245c1a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:57.760Z [qtp817348612-84] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=e6cb8c5a-eab9-4b5e-8bb7-4bf9bf245c1a InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=12257 EndTimestamp=2021-07-13T01:01:57.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:45.503Z InvocationID=354f329b-9bdd-4a9f-9f7f-ecc7d748395f ResponseDesc=Internal Server Error 2021-07-13T01:01:57.781Z [qtp817348612-51] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=55b01eca-1da2-40e8-baa1-40eda620a104 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:57.781Z [qtp817348612-74] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=3a822361-2f47-4630-8721-2327139fcabc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failure[cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:57.781Z [qtp817348612-51] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=55b01eca-1da2-40e8-baa1-40eda620a104 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:57.781Z [qtp817348612-74] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=3a822361-2f47-4630-8721-2327139fcabc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:57.781Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=55b01eca-1da2-40e8-baa1-40eda620a104 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=15341 EndTimestamp=2021-07-13T01:01:57.781Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:42.440Z InvocationID=ab995654-3486-4fd2-9c84-411b58ad38e9 ResponseDesc=Internal Server Error 2021-07-13T01:01:57.781Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=3a822361-2f47-4630-8721-2327139fcabc InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=23901 EndTimestamp=2021-07-13T01:01:57.781Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:33.880Z InvocationID=16f6ddb6-1299-43b8-a32a-d8f30d79e73f ResponseDesc=Internal Server Error 2021-07-13T01:01:59.686Z [qtp817348612-69] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7305e9b6-449b-4db3-a13d-06454e821348 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:59.686Z [qtp817348612-77] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0daebbc8-32eb-48a2-b8ec-13cfed5ea8f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:59.687Z [qtp817348612-71] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ac5e44f9-e66a-4e35-8d64-97328b2ce34b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:59.687Z [qtp817348612-86] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a210a798-9e37-47a8-88a0-d71006e99e65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:59.687Z [qtp817348612-81] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=09ed9d23-03fd-45ac-8dff-4cb47b658e30 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:59.687Z [qtp817348612-75] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d3d4d6ef-740c-4bf3-8057-8a7765e3e20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck [cassandra.onap/10.242.199.132:9042] Connection has been closed com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:38) at com.datastax.driver.core.exceptions.TransportException.copy(TransportException.java:24) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.TransportException: [cassandra.onap/10.242.199.132:9042] Connection has been closed at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1427) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1408) at com.datastax.driver.core.Connection.defunct(Connection.java:585) at com.datastax.driver.core.Connection$12.fail(Connection.java:1404) at com.datastax.driver.core.Connection$12.onTimeout(Connection.java:1397) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-13T01:01:59.759Z [qtp817348612-86] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=a210a798-9e37-47a8-88a0-d71006e99e65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T01:01:59.759Z [qtp817348612-77] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=0daebbc8-32eb-48a2-b8ec-13cfed5ea8f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T01:01:59.759Z [qtp817348612-77] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=0daebbc8-32eb-48a2-b8ec-13cfed5ea8f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T01:01:59.759Z [qtp817348612-86] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a210a798-9e37-47a8-88a0-d71006e99e65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T01:01:59.760Z [qtp817348612-86] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=a210a798-9e37-47a8-88a0-d71006e99e65 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=10061 EndTimestamp=2021-07-13T01:01:59.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:49.698Z InvocationID=67b48e08-0d6f-439c-b87d-dabc18394e83 ResponseDesc=Internal Server Error 2021-07-13T01:01:59.760Z [qtp817348612-77] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=0daebbc8-32eb-48a2-b8ec-13cfed5ea8f4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=6158 EndTimestamp=2021-07-13T01:01:59.759Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:53.601Z InvocationID=d1e32344-2608-4325-923b-f572deb4d15a ResponseDesc=Internal Server Error 2021-07-13T01:01:59.761Z [qtp817348612-81] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=09ed9d23-03fd-45ac-8dff-4cb47b658e30 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T01:01:59.761Z [qtp817348612-81] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=09ed9d23-03fd-45ac-8dff-4cb47b658e30 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 28 common frames omitted 2021-07-13T01:01:59.761Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=09ed9d23-03fd-45ac-8dff-4cb47b658e30 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2153 EndTimestamp=2021-07-13T01:01:59.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:57.608Z InvocationID=2f578196-cb9f-4304-9241-93f03dcc23fc ResponseDesc=Internal Server Error 2021-07-13T01:01:59.761Z [qtp817348612-69] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=7305e9b6-449b-4db3-a13d-06454e821348 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.761Z [qtp817348612-69] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=7305e9b6-449b-4db3-a13d-06454e821348 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.761Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=7305e9b6-449b-4db3-a13d-06454e821348 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=18454 EndTimestamp=2021-07-13T01:01:59.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:41.307Z InvocationID=3adce7b1-1c17-44b2-9769-8242dffe402e ResponseDesc=Internal Server Error 2021-07-13T01:01:59.762Z [qtp817348612-71] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ac5e44f9-e66a-4e35-8d64-97328b2ce34b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.763Z [qtp817348612-75] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d3d4d6ef-740c-4bf3-8057-8a7765e3e20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.767Z [qtp817348612-71] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=ac5e44f9-e66a-4e35-8d64-97328b2ce34b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.767Z [qtp817348612-71] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=ac5e44f9-e66a-4e35-8d64-97328b2ce34b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.767Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=ac5e44f9-e66a-4e35-8d64-97328b2ce34b InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=2328 EndTimestamp=2021-07-13T01:01:59.767Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:57.439Z InvocationID=1d5bd089-66cd-4b17-a0c3-064dcb4fb52b ResponseDesc=Internal Server Error 2021-07-13T01:01:59.771Z [qtp817348612-75] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=d3d4d6ef-740c-4bf3-8057-8a7765e3e20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.771Z [qtp817348612-75] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=d3d4d6ef-740c-4bf3-8057-8a7765e3e20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.771Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=d3d4d6ef-740c-4bf3-8057-8a7765e3e20f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=10895 EndTimestamp=2021-07-13T01:01:59.771Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:48.876Z InvocationID=1f11d51d-e716-446e-9e3b-8f781218b081 ResponseDesc=Internal Server Error 2021-07-13T01:01:59.774Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e9a10aab-224c-4594-8aa9-5046a3394313 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:01:59.774Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:59.774Z InvocationID=8d4c0d48-e6a0-4bc2-9662-aa4561543ff0 2021-07-13T01:01:59.860Z [qtp817348612-76] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e9a10aab-224c-4594-8aa9-5046a3394313 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.864Z [qtp817348612-76] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e9a10aab-224c-4594-8aa9-5046a3394313 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.868Z [qtp817348612-76] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=e9a10aab-224c-4594-8aa9-5046a3394313 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.868Z [qtp817348612-76] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=e9a10aab-224c-4594-8aa9-5046a3394313 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:01:59.868Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=e9a10aab-224c-4594-8aa9-5046a3394313 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=94 EndTimestamp=2021-07-13T01:01:59.868Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:01:59.774Z InvocationID=5646290b-3b61-4a18-9810-49bab61d505c ResponseDesc=Internal Server Error 2021-07-13T01:02:00.776Z [qtp817348612-87] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=23b7dcd1-b72b-4104-a1a4-e4fd36c8ade4 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T01:02:00.776Z ElapsedTime=0 EndTimestamp=2021-07-13T01:02:00.776Z InvocationID=d0cf8662-21e6-4abb-846e-808e612ca50c PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:02:00.862Z [qtp817348612-87] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=23b7dcd1-b72b-4104-a1a4-e4fd36c8ade4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:00.871Z [qtp817348612-87] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=23b7dcd1-b72b-4104-a1a4-e4fd36c8ade4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:00.879Z [qtp817348612-87] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=23b7dcd1-b72b-4104-a1a4-e4fd36c8ade4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:00.879Z [qtp817348612-87] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=23b7dcd1-b72b-4104-a1a4-e4fd36c8ade4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:00.879Z [qtp817348612-87] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=23b7dcd1-b72b-4104-a1a4-e4fd36c8ade4 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=103 EndTimestamp=2021-07-13T01:02:00.879Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:00.776Z InvocationID=106ea9f3-369b-4380-81b0-b690e7e11fb3 ResponseDesc=Internal Server Error 2021-07-13T01:02:01.671Z [qtp817348612-84] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c5748701-cece-4c5b-8f52-dc8b6177b386 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:01.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:01.671Z InvocationID=9db6b5f1-a452-4b4d-9fda-543a80ca745f 2021-07-13T01:02:01.757Z [qtp817348612-84] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c5748701-cece-4c5b-8f52-dc8b6177b386 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:01.763Z [qtp817348612-84] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=c5748701-cece-4c5b-8f52-dc8b6177b386 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:01.768Z [qtp817348612-84] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=c5748701-cece-4c5b-8f52-dc8b6177b386 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:01.768Z [qtp817348612-84] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=c5748701-cece-4c5b-8f52-dc8b6177b386 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:01.768Z [qtp817348612-84] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=c5748701-cece-4c5b-8f52-dc8b6177b386 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=97 EndTimestamp=2021-07-13T01:02:01.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:01.671Z InvocationID=bdeddce8-db52-493c-820e-083ec0a5511f ResponseDesc=Internal Server Error 2021-07-13T01:02:02.771Z [qtp817348612-88] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a8fa906f-dea6-48cf-b650-f26f0566da2f ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T01:02:02.771Z ElapsedTime=0 EndTimestamp=2021-07-13T01:02:02.771Z InvocationID=e9407098-063f-4f8b-b979-fbad2f8b4215 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:02:02.857Z [qtp817348612-88] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a8fa906f-dea6-48cf-b650-f26f0566da2f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:02.862Z [qtp817348612-88] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a8fa906f-dea6-48cf-b650-f26f0566da2f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:02.868Z [qtp817348612-88] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=a8fa906f-dea6-48cf-b650-f26f0566da2f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:02.868Z [qtp817348612-88] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=a8fa906f-dea6-48cf-b650-f26f0566da2f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:02.868Z [qtp817348612-88] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=a8fa906f-dea6-48cf-b650-f26f0566da2f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=97 EndTimestamp=2021-07-13T01:02:02.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:02.771Z InvocationID=2b3ea79d-0f6e-43e6-877c-ab7c0a073ae9 ResponseDesc=Internal Server Error 2021-07-13T01:02:03.761Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5a2e147a-9fd5-479c-acd7-0816ee905141 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:03.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:03.761Z InvocationID=3c036b85-c250-4714-ab77-0e9b119f95ff 2021-07-13T01:02:03.767Z [qtp817348612-71] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5a2e147a-9fd5-479c-acd7-0816ee905141 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:03.772Z [qtp817348612-71] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5a2e147a-9fd5-479c-acd7-0816ee905141 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:03.858Z [qtp817348612-71] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=5a2e147a-9fd5-479c-acd7-0816ee905141 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:03.858Z [qtp817348612-71] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=5a2e147a-9fd5-479c-acd7-0816ee905141 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:03.859Z [qtp817348612-71] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=5a2e147a-9fd5-479c-acd7-0816ee905141 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=98 EndTimestamp=2021-07-13T01:02:03.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:03.761Z InvocationID=9499c736-582d-413a-814c-3a3ca6987d61 ResponseDesc=Internal Server Error 2021-07-13T01:02:04.774Z [qtp817348612-86] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=98c37c4a-6aa3-45c7-9fe0-d4b2f950d832 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:04.774Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:04.774Z InvocationID=ca53e36a-734e-40cf-9bfb-87ec370148b5 2021-07-13T01:02:04.863Z [qtp817348612-86] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=98c37c4a-6aa3-45c7-9fe0-d4b2f950d832 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:04.872Z [qtp817348612-86] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=98c37c4a-6aa3-45c7-9fe0-d4b2f950d832 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:04.881Z [qtp817348612-86] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=98c37c4a-6aa3-45c7-9fe0-d4b2f950d832 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:04.881Z [qtp817348612-86] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=98c37c4a-6aa3-45c7-9fe0-d4b2f950d832 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:04.881Z [qtp817348612-86] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=98c37c4a-6aa3-45c7-9fe0-d4b2f950d832 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=107 EndTimestamp=2021-07-13T01:02:04.881Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:04.774Z InvocationID=46411bd8-7f95-415a-9576-210c20a2a719 ResponseDesc=Internal Server Error 2021-07-13T01:02:05.961Z [qtp817348612-85] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=41536dd2-5df9-4ea5-b88e-39fd5451cd6f ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 EntryTimestamp=2021-07-13T01:02:05.961Z ElapsedTime=0 EndTimestamp=2021-07-13T01:02:05.961Z InvocationID=443fd8af-5aa9-4c6d-9621-43061914bdb5 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:02:06.065Z [qtp817348612-85] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=41536dd2-5df9-4ea5-b88e-39fd5451cd6f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:06.072Z [qtp817348612-85] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=41536dd2-5df9-4ea5-b88e-39fd5451cd6f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.dao.impl.cassandra.$Proxy136.checkHealth(Unknown Source) at com.amdocs.zusammen.plugin.dao.impl.cassandra.VersionDaoImpl.checkHealth(VersionDaoImpl.java:62) at com.amdocs.zusammen.plugin.collaboration.impl.VersionPublicStoreImpl.checkHealth(VersionPublicStoreImpl.java:106) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.checkHealth(CassandraCollaborationStorePluginImpl.java:419) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getCollaborationStatus(HealthAdaptorImpl.java:78) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:17) at com.amdocs.zusammen.core.impl.health.CollaborationHealthService.checkHealth(CollaborationHealthService.java:9) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:47) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:06.163Z [qtp817348612-85] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=41536dd2-5df9-4ea5-b88e-39fd5451cd6f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureNot enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:06.163Z [qtp817348612-85] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=41536dd2-5df9-4ea5-b88e-39fd5451cd6f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:119) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:27) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:141) at com.datastax.driver.core.Responses$Error.asException(Responses.java:159) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_ONE (1 required but only 0 alive) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:78) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:02:06.164Z [qtp817348612-85] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=41536dd2-5df9-4ea5-b88e-39fd5451cd6f InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=203 EndTimestamp=2021-07-13T01:02:06.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:05.961Z InvocationID=f0055b6d-f83d-41cc-8ebb-b8b58fe26d26 ResponseDesc=Internal Server Error 2021-07-13T01:02:07.560Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6a544510-53b3-4757-b9e0-362410eea878 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:07.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:07.560Z InvocationID=8a86ec1b-1769-4796-b0e1-8b50b3e668c3 2021-07-13T01:02:07.657Z [qtp817348612-75] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6a544510-53b3-4757-b9e0-362410eea878 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:02:07.858Z [qtp817348612-75] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6a544510-53b3-4757-b9e0-362410eea878 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=298 EndTimestamp=2021-07-13T01:02:07.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:07.560Z InvocationID=1d6a1c81-3cc7-43a7-8f13-a56c80cb29c4 ResponseDesc=OK 2021-07-13T01:02:08.768Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=41e2c038-c871-4793-bdf4-aa2f870f99e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:08.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:08.768Z InvocationID=794d90c5-7e16-4c60-90af-6c01590ad056 2021-07-13T01:02:08.873Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d0a80f80-2005-481b-8691-20cccd6c5103 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:08.873Z InvocationID=70cbd7bd-9b9c-437f-8f9b-19e4d892aa72 2021-07-13T01:02:08.956Z [qtp817348612-69] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=41e2c038-c871-4793-bdf4-aa2f870f99e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:02:09.156Z [qtp817348612-51] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d0a80f80-2005-481b-8691-20cccd6c5103 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:02:09.159Z [qtp817348612-69] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=41e2c038-c871-4793-bdf4-aa2f870f99e8 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=391 EndTimestamp=2021-07-13T01:02:09.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:08.768Z InvocationID=9096be63-6442-455c-b974-c96198a9df16 ResponseDesc=OK 2021-07-13T01:02:09.357Z [qtp817348612-51] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d0a80f80-2005-481b-8691-20cccd6c5103 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=484 EndTimestamp=2021-07-13T01:02:09.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:08.873Z InvocationID=6943d6f4-7cb6-4613-b263-ba39389ffe5f ResponseDesc=OK 2021-07-13T01:02:11.028Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4a6fe226-c5be-46ff-9186-39121a4e7f7e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:11.027Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:11.027Z InvocationID=c1782e06-7721-43c1-b111-6b7ed172dfa4 2021-07-13T01:02:11.159Z [qtp817348612-81] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4a6fe226-c5be-46ff-9186-39121a4e7f7e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:02:11.360Z [qtp817348612-81] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4a6fe226-c5be-46ff-9186-39121a4e7f7e InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=333 EndTimestamp=2021-07-13T01:02:11.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:11.027Z InvocationID=4dc14ba4-a289-4d0c-81bf-06356e917567 ResponseDesc=OK 2021-07-13T01:02:18.877Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=10700b08-679d-4804-855a-c8f2d483e4a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:18.877Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:18.877Z InvocationID=337e6151-5ad7-48fb-856b-ba8012965ea7 2021-07-13T01:02:23.230Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0997bd5b-fce9-4248-a383-f51252a55101 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:23.230Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:23.230Z InvocationID=dcf58ac3-fca0-454c-b3bf-e1f3746e500c 2021-07-13T01:02:23.316Z [qtp817348612-76] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0997bd5b-fce9-4248-a383-f51252a55101 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:02:23.416Z [qtp817348612-74] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=10700b08-679d-4804-855a-c8f2d483e4a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:02:23.530Z [qtp817348612-76] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0997bd5b-fce9-4248-a383-f51252a55101 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=300 EndTimestamp=2021-07-13T01:02:23.530Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:23.230Z InvocationID=c32e3326-61b9-45a8-89e7-e76f96980d06 ResponseDesc=OK 2021-07-13T01:02:23.757Z [qtp817348612-74] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=10700b08-679d-4804-855a-c8f2d483e4a6 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=4880 EndTimestamp=2021-07-13T01:02:23.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:18.877Z InvocationID=3a8ec894-e435-468c-9440-53b1427636dc ResponseDesc=OK 2021-07-13T01:02:28.874Z [qtp817348612-84] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9772879-757c-45e4-a038-5a82eb6501a9 InstanceID=c66c8035-3478-4a12-aa25-d1669eb2a238 ElapsedTime=0 EndTimestamp=2021-07-13T01:02:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:02:28.874Z InvocationID=7521dfbd-3dc0-416b-bdae-8ca4dc8f85b8 2021-07-13T01:02:46.983Z [main] INFO o.s.web.context.ContextLoader Root WebApplicationContext: initialization started 2021-07-13T01:02:47.865Z [main] INFO o.h.validator.internal.util.Version HV000001: Hibernate Validator 5.3.6.Final 2021-07-13T01:02:48.224Z [main] INFO com.datastax.driver.core DataStax Java driver 3.8.0 for Apache Cassandra 2021-07-13T01:02:48.230Z [main] INFO c.d.driver.core.GuavaCompatibility Detected Guava >= 19 in the classpath, using modern compatibility layer 2021-07-13T01:02:48.246Z [main] INFO o.o.c.n.i.c.CassandraSessionFactory localDatacenter was provided, setting Cassndra client to use datacenter: Pod as local. 2021-07-13T01:02:48.254Z [main] INFO c.d.driver.core.SystemProperties com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false 2021-07-13T01:02:48.254Z [main] INFO c.datastax.driver.core.ClockFactory Using java.lang.System clock to generate timestamps. 2021-07-13T01:02:48.336Z [main] INFO o.o.c.n.i.c.CassandraSessionFactory Cassandra client created hosts: [cassandra.onap] port: 9042 SSL enabled: false reconnectTimeout 2021-07-13T01:02:48.413Z [main] INFO com.datastax.driver.core.NettyUtil Did not find Netty's native epoll transport in the classpath, defaulting to NIO. 2021-07-13T01:02:50.030Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-07-13T01:02:50.032Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.219.208:9042 added 2021-07-13T01:02:50.032Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.199.132:9042 added 2021-07-13T01:02:50.032Z [main] INFO com.datastax.driver.core.Cluster New Cassandra host cassandra.onap/10.242.211.142:9042 added 2021-07-13T01:02:56.117Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T01:02:56.190Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T01:02:56.343Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] because it collides with previously registered codec MappedUDTCodec [dox.version <-> org.openecomp.sdc.versioning.dao.types.Version] 2021-07-13T01:02:56.344Z [main] WARN c.datastax.driver.core.CodecRegistry Ignoring codec MappedUDTCodec [dox.user_candidate_version <-> org.openecomp.sdc.versioning.dao.types.UserCandidateVersion] because it collides with previously registered codec MappedUDTCodec [dox.user_candidate_version <-> org.openecomp.sdc.versioning.dao.types.UserCandidateVersion] 2021-07-13T01:02:57.110Z [main] INFO o.o.c.e.i.ExternalTestingManagerImpl loaded external testing config {"client":{"enabled":true},"endpoints":["vtp,VTP,true,http://refrepo:8702/onapapi/vnfsdk-marketplace,onap.*","repository,Repository,false,,.*"]} 2021-07-13T01:02:57.114Z [main] INFO o.o.c.e.i.ExternalTestingManagerImpl processed external testing config [{"enabled":true,"title":"VTP","url":"http://refrepo:8702/onapapi/vnfsdk-marketplace","id":"vtp","apiKey":null,"scenarioFilter":"onap.*"},{"enabled":false,"title":"Repository","url":"","id":"repository","apiKey":null,"scenarioFilter":".*"}] 2021-07-13T01:02:57.952Z [main] INFO org.apache.cxf.endpoint.ServerImpl Setting the server's publish address to be / 2021-07-13T01:02:58.040Z [main] INFO o.s.web.context.ContextLoader Root WebApplicationContext initialized in 11054 ms 2021-07-13T01:03:00.329Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T01:03:00.474Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T01:03:00.499Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-07-13T01:03:00.838Z [main] INFO o.s.web.servlet.DispatcherServlet Initializing Servlet 'spring-mapper' 2021-07-13T01:03:00.993Z [main] INFO o.s.web.servlet.DispatcherServlet Completed initialization in 155 ms 2021-07-13T01:03:01.285Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=00fda6ea-8e91-48d3-9b6e-d9dca6493a4b ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:01.276Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:01.276Z InvocationID=43b10c0e-d78f-493c-a523-4abf5bc9af29 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:01.285Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b4374ba7-e3e2-47ad-9285-56ad102f1c8f ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:01.276Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:01.276Z InvocationID=f556c031-468b-4f08-897e-d93cf35bea59 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:01.662Z [qtp817348612-14] INFO c.d.driver.core.SystemProperties RequestID=00fda6ea-8e91-48d3-9b6e-d9dca6493a4b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false 2021-07-13T01:03:01.662Z [qtp817348612-14] INFO c.datastax.driver.core.ClockFactory RequestID=00fda6ea-8e91-48d3-9b6e-d9dca6493a4b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Using java.lang.System clock to generate timestamps. 2021-07-13T01:03:01.993Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f92de418-2fbc-4ff7-88a8-be7195b91b16 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:01.993Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:01.993Z InvocationID=49dcbaeb-31e8-4294-8ab5-bf7a490d2604 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:10.099Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=50f567c4-a156-4adf-8ce7-a87167a3d964 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:10.099Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:10.099Z InvocationID=a8bbe5a5-bbfb-476b-aa02-37f7bc09e09e PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:11.115Z [qtp817348612-14] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=00fda6ea-8e91-48d3-9b6e-d9dca6493a4b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-07-13T01:03:11.115Z [qtp817348612-14] INFO com.datastax.driver.core.Cluster RequestID=00fda6ea-8e91-48d3-9b6e-d9dca6493a4b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.219.208:9042 added 2021-07-13T01:03:11.115Z [qtp817348612-14] INFO com.datastax.driver.core.Cluster RequestID=00fda6ea-8e91-48d3-9b6e-d9dca6493a4b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.199.132:9042 added 2021-07-13T01:03:11.115Z [qtp817348612-14] INFO com.datastax.driver.core.Cluster RequestID=00fda6ea-8e91-48d3-9b6e-d9dca6493a4b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck New Cassandra host cassandra.onap/10.242.211.142:9042 added 2021-07-13T01:03:12.333Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a1089acb-8dfc-49a0-91cd-0c2beaf69b55 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:12.333Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:12.333Z InvocationID=e645d85a-aa4f-485c-aba6-f45f59129783 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:13.734Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a1089acb-8dfc-49a0-91cd-0c2beaf69b55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T01:03:13.757Z [qtp817348612-13] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f92de418-2fbc-4ff7-88a8-be7195b91b16 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T01:03:13.761Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='INSERT INTO version (space, item_id, version_id, base_version_id, creation_time, modification_time) VALUES (?, ?, ?, ?, ?, ?)' 2021-07-13T01:03:13.763Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id, base_version_id, creation_time, modification_time FROM version WHERE space=? AND item_id=?' 2021-07-13T01:03:14.023Z [qtp817348612-19] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=50f567c4-a156-4adf-8ce7-a87167a3d964 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T01:03:14.027Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='UPDATE version SET modification_time=? WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T01:03:14.027Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id, base_version_id, creation_time, modification_time FROM version WHERE space=? AND item_id=?' 2021-07-13T01:03:14.056Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id, base_version_id, creation_time, modification_time FROM version WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T01:03:14.057Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='INSERT INTO version (space, item_id, version_id, base_version_id, creation_time, modification_time) VALUES (?, ?, ?, ?, ?, ?)' 2021-07-13T01:03:14.120Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='UPDATE version SET modification_time=? WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T01:03:14.120Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id, base_version_id, creation_time, modification_time FROM version WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T01:03:14.121Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id FROM version LIMIT 1' 2021-07-13T01:03:14.122Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='DELETE FROM version WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T01:03:14.123Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='DELETE FROM version WHERE space=? AND item_id=? AND version_id=? ' 2021-07-13T01:03:14.123Z [cluster2-worker-0] WARN com.datastax.driver.core.Cluster Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT version_id FROM version LIMIT 1' 2021-07-13T01:03:14.461Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b4374ba7-e3e2-47ad-9285-56ad102f1c8f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:14.521Z [qtp817348612-14] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=00fda6ea-8e91-48d3-9b6e-d9dca6493a4b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck null java.util.ConcurrentModificationException: null at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectionFactory.getMappingManager(CassandraConnectionFactory.java:57) at com.amdocs.zusammen.commons.db.impl.cassandra.CassandraConnectorImpl.getMappingManager(CassandraConnectorImpl.java:28) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.CassandraDaoUtils.getAccessor(CassandraDaoUtils.java:14) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.getAccessor(KeepAliveCassandraDao.java:18) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) 2021-07-13T01:03:14.676Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=50f567c4-a156-4adf-8ce7-a87167a3d964 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=4575 EndTimestamp=2021-07-13T01:03:14.674Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:10.099Z InvocationID=540d7f13-bb6b-433e-a3e8-78aeee56c410 ResponseDesc=Internal Server Error 2021-07-13T01:03:14.715Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=a1089acb-8dfc-49a0-91cd-0c2beaf69b55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2382 EndTimestamp=2021-07-13T01:03:14.715Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:12.333Z InvocationID=67583044-9d17-40dd-9970-bf87222109e2 ResponseDesc=Internal Server Error 2021-07-13T01:03:14.859Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b4374ba7-e3e2-47ad-9285-56ad102f1c8f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=13582 EndTimestamp=2021-07-13T01:03:14.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:01.276Z InvocationID=d0fdeacb-1ee4-4cae-8f45-fea313b74a57 ResponseDesc=OK 2021-07-13T01:03:14.860Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=00fda6ea-8e91-48d3-9b6e-d9dca6493a4b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=13583 EndTimestamp=2021-07-13T01:03:14.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:01.276Z InvocationID=5d33b6f1-1b31-4f38-923a-81f729855a86 ResponseDesc=Internal Server Error 2021-07-13T01:03:15.117Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=f92de418-2fbc-4ff7-88a8-be7195b91b16 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=13123 EndTimestamp=2021-07-13T01:03:15.116Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:01.993Z InvocationID=f894ba36-5353-4514-80cf-e1a63e169b11 ResponseDesc=Internal Server Error 2021-07-13T01:03:15.216Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=75ec750a-4536-435a-836a-733176f0955f ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:15.216Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:15.216Z InvocationID=5960f7bc-65e8-4895-9318-e2eba660e203 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:15.357Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=75ec750a-4536-435a-836a-733176f0955f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:15.658Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=75ec750a-4536-435a-836a-733176f0955f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=441 EndTimestamp=2021-07-13T01:03:15.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:15.216Z InvocationID=ae74ab7c-0dce-4842-a8f1-db349bdc742c ResponseDesc=OK 2021-07-13T01:03:16.663Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b38d9d4f-b6e3-4a1f-9dd0-dfdd8a02b59b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:16.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:16.663Z InvocationID=fbc8005f-3404-4b5b-97fe-e3e183956438 2021-07-13T01:03:16.859Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b38d9d4f-b6e3-4a1f-9dd0-dfdd8a02b59b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:18.420Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b38d9d4f-b6e3-4a1f-9dd0-dfdd8a02b59b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1757 EndTimestamp=2021-07-13T01:03:18.420Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:16.663Z InvocationID=d98f3e91-6ac9-43dc-9879-987717c85fc5 ResponseDesc=OK 2021-07-13T01:03:19.761Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=44892204-c2d0-4d3d-a9b0-bfc0db62b341 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:19.761Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:19.761Z InvocationID=1eaef331-3d91-4179-998d-26814f70afb0 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:20.013Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=44892204-c2d0-4d3d-a9b0-bfc0db62b341 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:20.262Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=44892204-c2d0-4d3d-a9b0-bfc0db62b341 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=500 EndTimestamp=2021-07-13T01:03:20.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:19.761Z InvocationID=6c300125-ed82-49f9-82d0-456e54ff1834 ResponseDesc=OK 2021-07-13T01:03:21.626Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8f7488a2-bbf2-4bcc-b6be-2dfb422b77fb ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:21.625Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:21.625Z InvocationID=0b11da20-c4e0-45b4-9c8e-5b0b8d3d745a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:21.757Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8f7488a2-bbf2-4bcc-b6be-2dfb422b77fb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:22.162Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8f7488a2-bbf2-4bcc-b6be-2dfb422b77fb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=536 EndTimestamp=2021-07-13T01:03:22.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:21.625Z InvocationID=90e61306-9b52-4228-a575-d47beb72fb44 ResponseDesc=OK 2021-07-13T01:03:22.332Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2a4768cf-11cc-4e3f-856b-bb7a7a8ae62b ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:22.331Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:22.331Z InvocationID=fe597d03-d415-4499-8126-a5e6b284ed54 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:22.659Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2a4768cf-11cc-4e3f-856b-bb7a7a8ae62b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:23.020Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2a4768cf-11cc-4e3f-856b-bb7a7a8ae62b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=689 EndTimestamp=2021-07-13T01:03:23.020Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:22.331Z InvocationID=eaf0adcb-2d21-45ee-b4fa-c3223a856a74 ResponseDesc=OK 2021-07-13T01:03:24.720Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a89bb570-9fd0-46ec-a380-6cf49c48c146 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:24.720Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:24.720Z InvocationID=5aaed1d2-8d92-4d45-9ac4-a3339c5d08e9 2021-07-13T01:03:25.318Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a89bb570-9fd0-46ec-a380-6cf49c48c146 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:25.571Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a89bb570-9fd0-46ec-a380-6cf49c48c146 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=850 EndTimestamp=2021-07-13T01:03:25.570Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:24.720Z InvocationID=88e8213a-38cb-4404-8b9a-3dea628ca17b ResponseDesc=OK 2021-07-13T01:03:27.443Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=385ed5be-c82f-4b9d-a5bb-d2594e2dcd83 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:27.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:27.443Z InvocationID=a0371654-e928-4436-ae7d-3582f9bb4269 2021-07-13T01:03:27.557Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=385ed5be-c82f-4b9d-a5bb-d2594e2dcd83 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:27.623Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c661df6f-a9d1-46ae-877c-b432cc191153 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:27.623Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:27.623Z InvocationID=bfadd070-e488-432d-80dd-1af5747f5921 2021-07-13T01:03:28.874Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5fa0cd46-4956-4445-885d-5d3d79480b91 ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:28.873Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:28.873Z InvocationID=2e505423-ccab-45f8-b3f5-af2fac2bdc6b PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:31.359Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5fa0cd46-4956-4445-885d-5d3d79480b91 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:31.458Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c661df6f-a9d1-46ae-877c-b432cc191153 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:31.560Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=385ed5be-c82f-4b9d-a5bb-d2594e2dcd83 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=4117 EndTimestamp=2021-07-13T01:03:31.560Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:27.443Z InvocationID=43fa78cb-aad4-419c-814c-4fb5720dc818 ResponseDesc=OK 2021-07-13T01:03:31.761Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5fa0cd46-4956-4445-885d-5d3d79480b91 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2888 EndTimestamp=2021-07-13T01:03:31.761Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:28.873Z InvocationID=8cb117e8-8ad2-46e5-9424-ef005ed72a6c ResponseDesc=OK 2021-07-13T01:03:31.826Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c661df6f-a9d1-46ae-877c-b432cc191153 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=4203 EndTimestamp=2021-07-13T01:03:31.826Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:27.623Z InvocationID=dd6e82cb-b3fb-4143-9ecf-ae89796ba7d6 ResponseDesc=OK 2021-07-13T01:03:32.181Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=06b940ee-97fc-4aab-a0cf-023d7543658a ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:32.181Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:32.181Z InvocationID=d559d8cb-0a72-43c6-a7a3-cfff1553836a PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:32.371Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=06b940ee-97fc-4aab-a0cf-023d7543658a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:32.761Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=06b940ee-97fc-4aab-a0cf-023d7543658a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=580 EndTimestamp=2021-07-13T01:03:32.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:32.181Z InvocationID=557f6556-19b1-4c81-8158-0f2ec55160a5 ResponseDesc=OK 2021-07-13T01:03:33.766Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d1db63f4-4b1f-46ac-9126-8df8f700d0bf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:33.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:33.766Z InvocationID=386503c5-9c93-45d2-8ca1-f4f9b7b088a7 2021-07-13T01:03:33.859Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d1db63f4-4b1f-46ac-9126-8df8f700d0bf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:34.113Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d1db63f4-4b1f-46ac-9126-8df8f700d0bf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=347 EndTimestamp=2021-07-13T01:03:34.113Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:33.766Z InvocationID=8711f8e9-6592-4a9f-85e3-374e42adfbe7 ResponseDesc=OK 2021-07-13T01:03:35.036Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4c31a446-b64c-466c-aee2-ffe339a8905d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:35.036Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:35.036Z InvocationID=e207f0e3-38b0-402c-b6ee-3551a8c5aea6 2021-07-13T01:03:35.214Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4c31a446-b64c-466c-aee2-ffe339a8905d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:35.461Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4c31a446-b64c-466c-aee2-ffe339a8905d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=425 EndTimestamp=2021-07-13T01:03:35.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:35.036Z InvocationID=c77d126c-ea18-49a1-b009-5db98a1fd289 ResponseDesc=OK 2021-07-13T01:03:36.850Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6177df1f-9008-4bda-b551-2414ad9f351d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:36.850Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:36.850Z InvocationID=11dc7188-1f5c-491a-83ce-4361c9f6b6d9 2021-07-13T01:03:36.961Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6177df1f-9008-4bda-b551-2414ad9f351d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:37.441Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a2702be3-532e-4802-8658-f81ac909ebb8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:37.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:37.441Z InvocationID=f6aa2bca-c9d6-4de5-a3c4-ff758b130410 2021-07-13T01:03:37.457Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6177df1f-9008-4bda-b551-2414ad9f351d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=607 EndTimestamp=2021-07-13T01:03:37.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:36.850Z InvocationID=2e49746f-2f55-4c86-83be-aa629cd2963a ResponseDesc=OK 2021-07-13T01:03:37.559Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a2702be3-532e-4802-8658-f81ac909ebb8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:38.179Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a2702be3-532e-4802-8658-f81ac909ebb8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=738 EndTimestamp=2021-07-13T01:03:38.179Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:37.441Z InvocationID=75d74da2-6140-44f1-aa47-dc5ccd21706d ResponseDesc=OK 2021-07-13T01:03:38.877Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dbf51179-11e9-4437-9e0b-6fa16c6de0c7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:38.876Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:38.876Z InvocationID=655565f3-5a30-4b9e-be02-5290c45c8e99 2021-07-13T01:03:39.943Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7c01a063-95a9-4318-a229-13c25edc196d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:39.943Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:39.943Z InvocationID=47bfc0c5-152d-4388-93ea-ce44e36b7132 2021-07-13T01:03:40.018Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dbf51179-11e9-4437-9e0b-6fa16c6de0c7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:40.859Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7c01a063-95a9-4318-a229-13c25edc196d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:40.860Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dbf51179-11e9-4437-9e0b-6fa16c6de0c7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1984 EndTimestamp=2021-07-13T01:03:40.860Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:38.876Z InvocationID=bb9d3a31-adef-48e5-94be-3f993334868c ResponseDesc=OK 2021-07-13T01:03:42.158Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7c01a063-95a9-4318-a229-13c25edc196d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2215 EndTimestamp=2021-07-13T01:03:42.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:39.943Z InvocationID=1014e9b3-36b2-43f2-bcd4-a0aa327edad6 ResponseDesc=OK 2021-07-13T01:03:43.165Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a5fd99ef-bd5d-45ff-9b24-6df549da8aac InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:43.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:43.165Z InvocationID=8b4c730a-0ae3-4893-915a-bb83a1d9dcac 2021-07-13T01:03:43.172Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a5fd99ef-bd5d-45ff-9b24-6df549da8aac InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:43.362Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a5fd99ef-bd5d-45ff-9b24-6df549da8aac InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=197 EndTimestamp=2021-07-13T01:03:43.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:43.165Z InvocationID=fb6302d9-dc24-4fea-89bc-af682f813c50 ResponseDesc=OK 2021-07-13T01:03:44.272Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f4c9344b-246b-461f-9277-aca3f2c46122 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:44.272Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:44.272Z InvocationID=052d16c8-c954-4fcd-9ee1-430265d76650 2021-07-13T01:03:44.365Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f4c9344b-246b-461f-9277-aca3f2c46122 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:44.460Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f4c9344b-246b-461f-9277-aca3f2c46122 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=188 EndTimestamp=2021-07-13T01:03:44.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:44.272Z InvocationID=45c8efc4-37cb-4baa-94fb-e5b36a5ab57a ResponseDesc=OK 2021-07-13T01:03:45.268Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d77f1c2-6775-4837-a8a9-acb59d38c6d1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:45.268Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:45.268Z InvocationID=aa1dbdce-7eb8-4806-affd-d8b36a66ace8 2021-07-13T01:03:45.460Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d77f1c2-6775-4837-a8a9-acb59d38c6d1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:45.781Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2d77f1c2-6775-4837-a8a9-acb59d38c6d1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=512 EndTimestamp=2021-07-13T01:03:45.780Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:45.268Z InvocationID=dfcda195-981c-4b4a-a945-d00555588fbb ResponseDesc=OK 2021-07-13T01:03:46.762Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=62154558-3ce4-4879-8e7c-27fd3d68987f ServiceName=GET: /onboarding-api/v1.0/healthcheck InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 EntryTimestamp=2021-07-13T01:03:46.762Z ElapsedTime=0 EndTimestamp=2021-07-13T01:03:46.762Z InvocationID=2cf727ac-b99f-42de-8bb3-10f226e97a30 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 2021-07-13T01:03:46.860Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=62154558-3ce4-4879-8e7c-27fd3d68987f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:47.119Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=62154558-3ce4-4879-8e7c-27fd3d68987f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=357 EndTimestamp=2021-07-13T01:03:47.119Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:46.762Z InvocationID=cd06b7a3-8491-4ed1-a7df-22bfcc32d25e ResponseDesc=OK 2021-07-13T01:03:47.442Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7341272f-115a-47db-b811-68c32b6cbdc4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:47.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:47.442Z InvocationID=8e3ce1da-eb7b-464b-9138-5f04707451f0 2021-07-13T01:03:47.569Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7341272f-115a-47db-b811-68c32b6cbdc4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:47.668Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7341272f-115a-47db-b811-68c32b6cbdc4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=226 EndTimestamp=2021-07-13T01:03:47.668Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:47.442Z InvocationID=dd73b9f3-41b1-4162-be40-a1b4516beca3 ResponseDesc=OK 2021-07-13T01:03:48.068Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d958ca9e-3546-435a-8d6a-512e3f543b9e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:48.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:48.068Z InvocationID=4d6d8dbd-5a4f-49b5-b8bc-b9f6bdf745c7 2021-07-13T01:03:48.876Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=681d7635-b7a4-4283-9d40-a7c5e7e4a302 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:48.875Z InvocationID=54315543-2821-4781-ad9d-5fc859c33b48 2021-07-13T01:03:53.958Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d958ca9e-3546-435a-8d6a-512e3f543b9e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:55.158Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d958ca9e-3546-435a-8d6a-512e3f543b9e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=7090 EndTimestamp=2021-07-13T01:03:55.158Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:48.068Z InvocationID=89428ac8-cb1b-40f6-8041-e3e1c53efd84 ResponseDesc=OK 2021-07-13T01:03:55.915Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=681d7635-b7a4-4283-9d40-a7c5e7e4a302 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:56.524Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=681d7635-b7a4-4283-9d40-a7c5e7e4a302 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=7648 EndTimestamp=2021-07-13T01:03:56.523Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:48.875Z InvocationID=02a3f4bd-ba67-4bc2-84f8-ec008da1031e ResponseDesc=OK 2021-07-13T01:03:57.231Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da5b6c84-9509-47e9-acdc-0d27526f42ab InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:57.231Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:57.231Z InvocationID=309437a5-c6c5-4b21-a513-82db551bea9d 2021-07-13T01:03:57.441Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c7bc098c-2ac0-4f14-aac7-57824818fcd6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:57.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:57.441Z InvocationID=2a38f463-a1bf-4f99-9ba5-19206a80981a 2021-07-13T01:03:57.559Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c7bc098c-2ac0-4f14-aac7-57824818fcd6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:57.730Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da5b6c84-9509-47e9-acdc-0d27526f42ab InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:58.876Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d0471832-0c9f-4cb7-9389-3c1b0e91525a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:03:58.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:58.875Z InvocationID=c34ad3e8-38bf-4d10-8814-57f73567f3ff 2021-07-13T01:03:59.559Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d0471832-0c9f-4cb7-9389-3c1b0e91525a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:03:59.560Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c7bc098c-2ac0-4f14-aac7-57824818fcd6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2119 EndTimestamp=2021-07-13T01:03:59.560Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:57.441Z InvocationID=0c7d3a97-9d2a-458b-9b0c-77454d1b616a ResponseDesc=OK 2021-07-13T01:03:59.686Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d0471832-0c9f-4cb7-9389-3c1b0e91525a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=811 EndTimestamp=2021-07-13T01:03:59.686Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:58.875Z InvocationID=96480b86-bb36-4efb-aaf2-11e7d9e0e4dc ResponseDesc=OK 2021-07-13T01:03:59.758Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da5b6c84-9509-47e9-acdc-0d27526f42ab InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2526 EndTimestamp=2021-07-13T01:03:59.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:03:57.231Z InvocationID=26ef5644-dfd8-465b-af0b-e2f0ad1cec8d ResponseDesc=OK 2021-07-13T01:04:00.772Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8660db5c-f3a4-409b-9a32-d76db80fbca0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:00.771Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:00.771Z InvocationID=de692532-1dd6-4731-8930-c83b218a9e41 2021-07-13T01:04:00.863Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8660db5c-f3a4-409b-9a32-d76db80fbca0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:01.162Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8660db5c-f3a4-409b-9a32-d76db80fbca0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=390 EndTimestamp=2021-07-13T01:04:01.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:00.771Z InvocationID=a35dbfac-c88a-4060-bed8-7c7a26747542 ResponseDesc=OK 2021-07-13T01:04:02.363Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6080415f-d95e-44ee-bde9-b2c92bc9a243 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:02.363Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:02.363Z InvocationID=23679a5f-7e68-4c4d-a9dc-02db801e17d5 2021-07-13T01:04:02.457Z [qtp817348612-15] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6080415f-d95e-44ee-bde9-b2c92bc9a243 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:02.760Z [qtp817348612-15] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6080415f-d95e-44ee-bde9-b2c92bc9a243 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=397 EndTimestamp=2021-07-13T01:04:02.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:02.363Z InvocationID=8700c9d3-061f-49ab-b3b1-c48c2f433e2a ResponseDesc=OK 2021-07-13T01:04:03.773Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6028a3b3-5865-47de-ba0c-3ab170432075 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:03.773Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:03.773Z InvocationID=55f33507-7cd7-4bac-83ff-9fd5285de5bd 2021-07-13T01:04:03.867Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6028a3b3-5865-47de-ba0c-3ab170432075 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:04.768Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6028a3b3-5865-47de-ba0c-3ab170432075 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=994 EndTimestamp=2021-07-13T01:04:04.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:03.773Z InvocationID=9e926a87-69e3-4be9-8557-aebfe3c0cdfe ResponseDesc=OK 2021-07-13T01:04:05.764Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d45d42fe-f415-46f6-af86-a00299b060d4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:05.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:05.764Z InvocationID=0eda1468-8c37-43b9-bece-ae71af902e4c 2021-07-13T01:04:06.715Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d45d42fe-f415-46f6-af86-a00299b060d4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:06.876Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d45d42fe-f415-46f6-af86-a00299b060d4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1111 EndTimestamp=2021-07-13T01:04:06.875Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:05.764Z InvocationID=6ddd5e09-8a6e-4313-b2ab-f7d2c17ed654 ResponseDesc=OK 2021-07-13T01:04:07.441Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fbc2e0f9-baec-4fef-bdb0-e03d4c04f487 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:07.440Z InvocationID=3bec848b-c76c-47f5-ad53-4b8c095d5fef 2021-07-13T01:04:07.557Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fbc2e0f9-baec-4fef-bdb0-e03d4c04f487 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:07.858Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fbc2e0f9-baec-4fef-bdb0-e03d4c04f487 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=418 EndTimestamp=2021-07-13T01:04:07.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:07.440Z InvocationID=61c1479f-7b94-4935-8226-c9d799783ddd ResponseDesc=OK 2021-07-13T01:04:08.066Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=62663db5-1da4-4d4b-88d1-8d4dcfea6d35 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:08.066Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:08.066Z InvocationID=4e98998b-920f-4966-9181-415b8c372322 2021-07-13T01:04:08.160Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=62663db5-1da4-4d4b-88d1-8d4dcfea6d35 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:08.416Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=62663db5-1da4-4d4b-88d1-8d4dcfea6d35 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=350 EndTimestamp=2021-07-13T01:04:08.416Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:08.066Z InvocationID=07ccdd03-137b-4705-a10e-2e59ee5060c9 ResponseDesc=OK 2021-07-13T01:04:08.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=18d0305b-987e-49fa-9c08-28e6dd6d4a5e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:08.874Z InvocationID=e1ce9984-af08-45db-9359-144f90be6897 2021-07-13T01:04:09.631Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ec852135-3803-4fab-a49f-0b728fe35683 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:09.630Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:09.630Z InvocationID=47f88c66-502b-433e-b96f-d0ef5af7a816 2021-07-13T01:04:11.260Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ec852135-3803-4fab-a49f-0b728fe35683 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:12.561Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ec852135-3803-4fab-a49f-0b728fe35683 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2931 EndTimestamp=2021-07-13T01:04:12.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:09.630Z InvocationID=dc69b1a4-4fbb-42ce-9ef1-15fc8978b33b ResponseDesc=OK 2021-07-13T01:04:14.331Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=18d0305b-987e-49fa-9c08-28e6dd6d4a5e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:15.358Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=18d0305b-987e-49fa-9c08-28e6dd6d4a5e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=6484 EndTimestamp=2021-07-13T01:04:15.358Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:08.874Z InvocationID=0e1f2e57-c05d-420a-bd13-21d4cfd1f60f ResponseDesc=OK 2021-07-13T01:04:15.627Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=29584abd-79b2-4b62-9823-3810ed32c4f0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:15.627Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:15.627Z InvocationID=014751cd-64d3-478b-999f-9444c9a2d218 2021-07-13T01:04:15.759Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=29584abd-79b2-4b62-9823-3810ed32c4f0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:16.361Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=29584abd-79b2-4b62-9823-3810ed32c4f0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=733 EndTimestamp=2021-07-13T01:04:16.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:15.627Z InvocationID=e638e59b-3f63-4044-bdf4-395e161cec9b ResponseDesc=OK 2021-07-13T01:04:17.447Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4e1c7409-3864-4c8c-b674-c7c437e24261 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:17.447Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:17.447Z InvocationID=64ba4e95-9f77-4032-b634-263591947cfc 2021-07-13T01:04:17.623Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4e1c7409-3864-4c8c-b674-c7c437e24261 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:17.670Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f85713e-6b53-4ce3-aa1f-73a7ec07282d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:17.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:17.670Z InvocationID=d4d88194-434e-4c59-8a57-bde2bc50cf05 2021-07-13T01:04:18.174Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4e1c7409-3864-4c8c-b674-c7c437e24261 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=727 EndTimestamp=2021-07-13T01:04:18.174Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:17.447Z InvocationID=f562404c-1620-4fa9-84fa-b4d8ec1a947e ResponseDesc=OK 2021-07-13T01:04:18.256Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f85713e-6b53-4ce3-aa1f-73a7ec07282d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:18.858Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0f85713e-6b53-4ce3-aa1f-73a7ec07282d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1187 EndTimestamp=2021-07-13T01:04:18.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:17.670Z InvocationID=15efdb48-eefc-47a1-b49f-ffa1697bd672 ResponseDesc=OK 2021-07-13T01:04:18.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=834a5d37-26be-4217-9be5-a45fb7205c71 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:18.874Z InvocationID=8dc39661-1608-4dc5-9812-8e16465c56e1 2021-07-13T01:04:19.059Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=834a5d37-26be-4217-9be5-a45fb7205c71 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:22.928Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=834a5d37-26be-4217-9be5-a45fb7205c71 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=4053 EndTimestamp=2021-07-13T01:04:22.927Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:18.874Z InvocationID=801ba358-1b87-4793-b5b9-c3444ff0fc5b ResponseDesc=OK 2021-07-13T01:04:22.930Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0263a8a2-42be-47bc-ad30-6ef641f3eefd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:22.929Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:22.929Z InvocationID=29f6a835-c5c0-442c-9b51-b26820f006e6 2021-07-13T01:04:23.126Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0263a8a2-42be-47bc-ad30-6ef641f3eefd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:23.659Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0263a8a2-42be-47bc-ad30-6ef641f3eefd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=730 EndTimestamp=2021-07-13T01:04:23.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:22.929Z InvocationID=4a5e2078-e37f-4782-a049-5caf237fb050 ResponseDesc=OK 2021-07-13T01:04:24.966Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0d277459-9784-4caa-95c9-01538f3a7613 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:24.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:24.966Z InvocationID=fd7c6dee-7312-4a90-b9cf-153ac2dc5bae 2021-07-13T01:04:25.357Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0d277459-9784-4caa-95c9-01538f3a7613 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:26.758Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0d277459-9784-4caa-95c9-01538f3a7613 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1792 EndTimestamp=2021-07-13T01:04:26.758Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:24.966Z InvocationID=0f5d8d74-5ff8-4122-8051-cebcbc3ae094 ResponseDesc=OK 2021-07-13T01:04:27.441Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ac1b109d-f96e-4aee-be07-141ed91580e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:27.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:27.441Z InvocationID=314d4fb0-b7ef-4143-9ff2-ba6320553540 2021-07-13T01:04:27.559Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ac1b109d-f96e-4aee-be07-141ed91580e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:28.319Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9ac96a14-9726-43d2-a9b8-42da5d421b8d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:28.319Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:28.319Z InvocationID=14e8bcb1-6463-4da0-b006-8411a347363e 2021-07-13T01:04:28.874Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e5cc39f-cf09-420c-b706-20ea951d1a88 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:28.874Z InvocationID=9d2ec4b9-af2c-40bc-85e9-d4db78ce8346 2021-07-13T01:04:28.916Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ac1b109d-f96e-4aee-be07-141ed91580e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1475 EndTimestamp=2021-07-13T01:04:28.916Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:27.441Z InvocationID=8754609e-c76b-4512-a145-c247f6596528 ResponseDesc=OK 2021-07-13T01:04:28.960Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e5cc39f-cf09-420c-b706-20ea951d1a88 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:29.016Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9ac96a14-9726-43d2-a9b8-42da5d421b8d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:29.160Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e5cc39f-cf09-420c-b706-20ea951d1a88 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=286 EndTimestamp=2021-07-13T01:04:29.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:28.874Z InvocationID=a231b1c4-cf47-403f-839b-d5f77b39dd62 ResponseDesc=OK 2021-07-13T01:04:30.158Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9ac96a14-9726-43d2-a9b8-42da5d421b8d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1838 EndTimestamp=2021-07-13T01:04:30.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:28.319Z InvocationID=c741a82c-bedb-4ca7-a8c6-f2fcaf62e543 ResponseDesc=OK 2021-07-13T01:04:32.923Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=00ea245a-b9c3-4262-90ef-76d8114a6f77 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:32.923Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:32.923Z InvocationID=218d6097-6b62-4dfa-953c-4f8ae7ac53be 2021-07-13T01:04:32.958Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=00ea245a-b9c3-4262-90ef-76d8114a6f77 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:33.760Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=00ea245a-b9c3-4262-90ef-76d8114a6f77 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=837 EndTimestamp=2021-07-13T01:04:33.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:32.923Z InvocationID=9fd23335-0aa4-412d-83f2-03837d5e5112 ResponseDesc=OK 2021-07-13T01:04:35.781Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=45ef1c84-dfeb-4936-830e-40b1d0220c6c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:35.780Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:35.780Z InvocationID=0a553564-bd69-46c6-bb1b-6bcfac24e447 2021-07-13T01:04:36.198Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=45ef1c84-dfeb-4936-830e-40b1d0220c6c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:36.460Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=45ef1c84-dfeb-4936-830e-40b1d0220c6c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=680 EndTimestamp=2021-07-13T01:04:36.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:35.780Z InvocationID=6e19a5b1-8cf3-4e42-ba85-37aeb9108810 ResponseDesc=OK 2021-07-13T01:04:37.440Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=22047b78-a524-4ca3-ac7e-681a0b588216 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:37.440Z InvocationID=862fbde0-7e9b-4763-a12a-f186afd14304 2021-07-13T01:04:37.557Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=22047b78-a524-4ca3-ac7e-681a0b588216 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:38.876Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7a63ca0d-a346-41eb-b2ee-293f0837fe86 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:38.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:38.875Z InvocationID=0e80ce15-1791-4ac8-aa41-b213e9a44006 2021-07-13T01:04:38.958Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=22047b78-a524-4ca3-ac7e-681a0b588216 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1518 EndTimestamp=2021-07-13T01:04:38.958Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:37.440Z InvocationID=b9cca160-e85b-49da-9d5f-3ace27ea5c88 ResponseDesc=OK 2021-07-13T01:04:39.066Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7a63ca0d-a346-41eb-b2ee-293f0837fe86 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:39.222Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fef72c92-69c8-4628-85d3-2da820199377 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:39.222Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:39.222Z InvocationID=020d15d6-44d2-48c8-a1ee-38e911b3c546 2021-07-13T01:04:39.366Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fef72c92-69c8-4628-85d3-2da820199377 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:39.371Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7a63ca0d-a346-41eb-b2ee-293f0837fe86 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=496 EndTimestamp=2021-07-13T01:04:39.371Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:38.875Z InvocationID=abc8c585-de15-4483-9176-e772c0c0b6f9 ResponseDesc=OK 2021-07-13T01:04:39.472Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fef72c92-69c8-4628-85d3-2da820199377 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=250 EndTimestamp=2021-07-13T01:04:39.472Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:39.222Z InvocationID=cd754459-1ec6-4728-abe6-9ea050aa5fab ResponseDesc=OK 2021-07-13T01:04:40.364Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4c9dd254-10e0-4f68-bcec-b505e6e9e984 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:40.363Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:40.363Z InvocationID=85f861ed-7c09-4443-8cfc-4cef9e44fa81 2021-07-13T01:04:40.558Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4c9dd254-10e0-4f68-bcec-b505e6e9e984 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:40.857Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4c9dd254-10e0-4f68-bcec-b505e6e9e984 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=494 EndTimestamp=2021-07-13T01:04:40.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:40.363Z InvocationID=75eb62af-1537-4b40-b0f2-69ed1b4032d1 ResponseDesc=OK 2021-07-13T01:04:42.587Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=054d13dc-4bd4-4c56-af29-bdc5a1965279 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:42.587Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:42.587Z InvocationID=61eb75f4-22ec-408d-99fb-0e5b180dfca9 2021-07-13T01:04:42.671Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=054d13dc-4bd4-4c56-af29-bdc5a1965279 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:42.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=054d13dc-4bd4-4c56-af29-bdc5a1965279 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=286 EndTimestamp=2021-07-13T01:04:42.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:42.587Z InvocationID=8992c92f-4482-4dda-a1d2-ede5b80de261 ResponseDesc=OK 2021-07-13T01:04:43.882Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a6035b5d-3f34-4123-8948-ec083f38e897 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:43.882Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:43.882Z InvocationID=8e803943-f8e3-423c-a4d9-e3650f704cf6 2021-07-13T01:04:43.962Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a6035b5d-3f34-4123-8948-ec083f38e897 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:44.165Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a6035b5d-3f34-4123-8948-ec083f38e897 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=283 EndTimestamp=2021-07-13T01:04:44.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:43.882Z InvocationID=92861bac-ea21-4e9e-a6f5-8a3e840b6e74 ResponseDesc=OK 2021-07-13T01:04:45.065Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d75ef961-1e5a-4c5e-a0af-fc2090df1ef1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:45.065Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:45.065Z InvocationID=b53760da-5ef1-437d-90d9-e7d1995c7673 2021-07-13T01:04:45.157Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d75ef961-1e5a-4c5e-a0af-fc2090df1ef1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:45.758Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d75ef961-1e5a-4c5e-a0af-fc2090df1ef1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=692 EndTimestamp=2021-07-13T01:04:45.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:45.065Z InvocationID=aa5ee4cb-72a9-4d2e-ad43-7e0c55dc79d3 ResponseDesc=OK 2021-07-13T01:04:46.561Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fa134395-9f40-4101-8758-1a923700d7dc InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:46.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:46.560Z InvocationID=3b4fac00-fb56-40f5-82dd-b3159a1e4a9e 2021-07-13T01:04:46.660Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fa134395-9f40-4101-8758-1a923700d7dc InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:47.016Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fa134395-9f40-4101-8758-1a923700d7dc InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=455 EndTimestamp=2021-07-13T01:04:47.015Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:46.560Z InvocationID=18bba93a-1068-4d97-894f-3b2995364612 ResponseDesc=OK 2021-07-13T01:04:47.441Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c50c4ea0-1930-4d91-88f4-aaced9d62302 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:47.440Z InvocationID=07f4e87b-ebde-4985-8c4f-cb402ebc1826 2021-07-13T01:04:47.483Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c50c4ea0-1930-4d91-88f4-aaced9d62302 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:47.569Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c50c4ea0-1930-4d91-88f4-aaced9d62302 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=129 EndTimestamp=2021-07-13T01:04:47.569Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:47.440Z InvocationID=bb597cc3-a9e8-42a2-942b-4ef2d1f22f90 ResponseDesc=OK 2021-07-13T01:04:48.073Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7ec43605-5604-4efe-97de-e563560752c1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:48.072Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:48.072Z InvocationID=a239b4b2-2aec-4c13-911a-90244a1301c5 2021-07-13T01:04:48.169Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7ec43605-5604-4efe-97de-e563560752c1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:48.364Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7ec43605-5604-4efe-97de-e563560752c1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=292 EndTimestamp=2021-07-13T01:04:48.364Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:48.072Z InvocationID=765625f2-c49d-4369-babe-a08e87eed74f ResponseDesc=OK 2021-07-13T01:04:48.874Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=011f03ac-1657-49ba-9b85-03de7efe9765 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:48.874Z InvocationID=f96e55d9-6382-4083-82a9-e5a1996fccd7 2021-07-13T01:04:48.961Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=011f03ac-1657-49ba-9b85-03de7efe9765 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:49.331Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=011f03ac-1657-49ba-9b85-03de7efe9765 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=457 EndTimestamp=2021-07-13T01:04:49.331Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:48.874Z InvocationID=9f37ebae-bb84-4181-b15d-f795893186f9 ResponseDesc=OK 2021-07-13T01:04:49.579Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=22b04531-8098-44f9-8e87-b7a0304672c3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:49.578Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:49.578Z InvocationID=5fb19241-c0ec-4a73-beca-f4038fb1f3ba 2021-07-13T01:04:49.815Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=22b04531-8098-44f9-8e87-b7a0304672c3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:50.060Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=22b04531-8098-44f9-8e87-b7a0304672c3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=482 EndTimestamp=2021-07-13T01:04:50.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:49.578Z InvocationID=d89eecbd-89ef-4ae3-8875-14d20d698d8a ResponseDesc=OK 2021-07-13T01:04:51.075Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2b183f5e-b17b-4274-bc78-2f4d4ddf6962 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:51.075Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:51.075Z InvocationID=dbcc01dd-c3e8-498c-b510-10e5c7bc411d 2021-07-13T01:04:51.257Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2b183f5e-b17b-4274-bc78-2f4d4ddf6962 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:51.658Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2b183f5e-b17b-4274-bc78-2f4d4ddf6962 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=583 EndTimestamp=2021-07-13T01:04:51.658Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:51.075Z InvocationID=3868158a-cb01-4d01-a2a5-d2570cfb0457 ResponseDesc=OK 2021-07-13T01:04:52.360Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d79c07c0-5ff4-4b18-8c1e-6afe32929c04 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:52.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:52.360Z InvocationID=c2ca30c1-12f8-47e4-9a57-e8b8a0affac2 2021-07-13T01:04:52.459Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d79c07c0-5ff4-4b18-8c1e-6afe32929c04 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:52.716Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d79c07c0-5ff4-4b18-8c1e-6afe32929c04 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=356 EndTimestamp=2021-07-13T01:04:52.716Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:52.360Z InvocationID=1663453b-a917-48bd-a7a2-8c03593ffedc ResponseDesc=OK 2021-07-13T01:04:53.569Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=39ba403c-0285-4c87-aa94-3bbd10da05c2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:53.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:53.569Z InvocationID=a5c18797-398f-4a73-87b6-0a078b71174f 2021-07-13T01:04:53.818Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=39ba403c-0285-4c87-aa94-3bbd10da05c2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:54.161Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=39ba403c-0285-4c87-aa94-3bbd10da05c2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=591 EndTimestamp=2021-07-13T01:04:54.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:53.569Z InvocationID=5e57ca0a-5429-4fe0-acaf-1112c73015a9 ResponseDesc=OK 2021-07-13T01:04:55.366Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=875443f6-d62a-4cd1-a597-fa2256687add InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:55.366Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:55.366Z InvocationID=e39c2d0a-5377-49e6-b3c6-bb26c8caa7f5 2021-07-13T01:04:55.557Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=875443f6-d62a-4cd1-a597-fa2256687add InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:55.858Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=875443f6-d62a-4cd1-a597-fa2256687add InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=492 EndTimestamp=2021-07-13T01:04:55.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:55.366Z InvocationID=cb4b9f94-4e12-4667-8ce3-f089e96ba72d ResponseDesc=OK 2021-07-13T01:04:57.064Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4aabb22d-aaf4-4f77-8dcc-f4028bda7f34 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:57.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:57.064Z InvocationID=0ba83258-c5ff-4acd-b862-4ada48f1e242 2021-07-13T01:04:57.162Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4aabb22d-aaf4-4f77-8dcc-f4028bda7f34 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:57.441Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=82b8042e-771f-4cf9-9010-be4068d9c2c2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:57.440Z InvocationID=94f4ad6d-6a6d-4424-a7d1-c88b9fe70848 2021-07-13T01:04:57.617Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4aabb22d-aaf4-4f77-8dcc-f4028bda7f34 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=552 EndTimestamp=2021-07-13T01:04:57.616Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:57.064Z InvocationID=f040655a-2d98-4947-8dea-8d4eedc4ce66 ResponseDesc=OK 2021-07-13T01:04:57.814Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=82b8042e-771f-4cf9-9010-be4068d9c2c2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:58.061Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=82b8042e-771f-4cf9-9010-be4068d9c2c2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=620 EndTimestamp=2021-07-13T01:04:58.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:57.440Z InvocationID=19ea5a97-6041-48ea-b0a5-c8f6ef133e65 ResponseDesc=OK 2021-07-13T01:04:58.578Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=01794a70-70a0-47be-82c9-871d66059924 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:58.578Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:58.578Z InvocationID=8d1ebe82-46c1-431c-afdb-baae9a82ff3a 2021-07-13T01:04:58.857Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=01794a70-70a0-47be-82c9-871d66059924 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:58.875Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f840c46-073e-4d8d-ab04-4a2db9ad2dd7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:04:58.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:58.875Z InvocationID=db1baead-9cdb-4f3a-a6a3-7313d13119b1 2021-07-13T01:04:58.961Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f840c46-073e-4d8d-ab04-4a2db9ad2dd7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:04:59.158Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0f840c46-073e-4d8d-ab04-4a2db9ad2dd7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=282 EndTimestamp=2021-07-13T01:04:59.157Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:58.875Z InvocationID=b81eb90f-4e30-49a7-9ab7-d621c269d7c4 ResponseDesc=OK 2021-07-13T01:04:59.576Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=01794a70-70a0-47be-82c9-871d66059924 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=998 EndTimestamp=2021-07-13T01:04:59.576Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:04:58.578Z InvocationID=90bd6ceb-e62d-4c57-9cf4-b19d9cbd0004 ResponseDesc=OK 2021-07-13T01:05:00.674Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce693beb-7ba4-4711-bb38-c96e0e027b71 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:00.674Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:00.674Z InvocationID=72d67a3a-9e8b-4291-801e-0635528831b4 2021-07-13T01:05:01.020Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce693beb-7ba4-4711-bb38-c96e0e027b71 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:01.360Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ce693beb-7ba4-4711-bb38-c96e0e027b71 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=686 EndTimestamp=2021-07-13T01:05:01.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:00.674Z InvocationID=8768a59a-9eef-48b6-b784-98b70e50a5ec ResponseDesc=OK 2021-07-13T01:05:02.561Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=353a48a0-ecfb-47af-9271-d95b554fe1ed InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:02.561Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:02.561Z InvocationID=0819f99b-9af2-407b-a1bd-3bec23a618c0 2021-07-13T01:05:02.658Z [qtp817348612-14] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=353a48a0-ecfb-47af-9271-d95b554fe1ed InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:03.058Z [qtp817348612-14] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=353a48a0-ecfb-47af-9271-d95b554fe1ed InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=497 EndTimestamp=2021-07-13T01:05:03.058Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:02.561Z InvocationID=b641945b-0f9c-4c52-a8dc-8f30e1dad83e ResponseDesc=OK 2021-07-13T01:05:03.922Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fea70893-afd2-451e-9df4-7c09decc6225 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:03.921Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:03.921Z InvocationID=e27f371e-1b48-4c88-a654-dcd0031a7ff3 2021-07-13T01:05:04.059Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fea70893-afd2-451e-9df4-7c09decc6225 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:04.336Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fea70893-afd2-451e-9df4-7c09decc6225 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=414 EndTimestamp=2021-07-13T01:05:04.335Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:03.921Z InvocationID=b14146a0-cab8-435c-b8d8-51f221f93d4c ResponseDesc=OK 2021-07-13T01:05:05.572Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2e6f0454-a347-4d02-bd65-e95a23a7a779 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:05.571Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:05.571Z InvocationID=21074614-9f52-45e1-adc3-20577c8e924d 2021-07-13T01:05:05.816Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2e6f0454-a347-4d02-bd65-e95a23a7a779 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:07.060Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2e6f0454-a347-4d02-bd65-e95a23a7a779 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1489 EndTimestamp=2021-07-13T01:05:07.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:05.571Z InvocationID=9490b783-caab-42ed-bab9-0a346facd6de ResponseDesc=OK 2021-07-13T01:05:07.441Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aa3e0dff-e594-4ac6-a5e4-38be3d5dbdf9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:07.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:07.441Z InvocationID=d6aaa743-b14e-40a2-9f11-cbc91618959d 2021-07-13T01:05:07.656Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aa3e0dff-e594-4ac6-a5e4-38be3d5dbdf9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:08.058Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aa3e0dff-e594-4ac6-a5e4-38be3d5dbdf9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=617 EndTimestamp=2021-07-13T01:05:08.058Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:07.441Z InvocationID=e760d3db-dfd6-4b26-9d61-9eb0affcf827 ResponseDesc=OK 2021-07-13T01:05:08.168Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d943e589-e451-4f06-a3d4-cd3d76795bf6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:08.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:08.168Z InvocationID=865ef4c9-e44c-45f9-b023-437a0bbf757a 2021-07-13T01:05:08.260Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d943e589-e451-4f06-a3d4-cd3d76795bf6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:08.616Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d943e589-e451-4f06-a3d4-cd3d76795bf6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=447 EndTimestamp=2021-07-13T01:05:08.615Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:08.168Z InvocationID=11881a2e-f292-4d55-825a-1fd8c928d362 ResponseDesc=OK 2021-07-13T01:05:08.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b6883709-5c14-4b71-aa30-4abd0753bf40 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:08.873Z InvocationID=db7c16b9-32af-4e6b-850e-763af3f0e635 2021-07-13T01:05:09.112Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b6883709-5c14-4b71-aa30-4abd0753bf40 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:09.360Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b6883709-5c14-4b71-aa30-4abd0753bf40 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=487 EndTimestamp=2021-07-13T01:05:09.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:08.873Z InvocationID=ea9953ab-f781-4263-91a1-4817289204a0 ResponseDesc=OK 2021-07-13T01:05:09.672Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=565e19a7-e207-4f53-ac5e-dcb5e1fc372d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:09.672Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:09.672Z InvocationID=a9df9a77-c968-45f8-9c0d-15fc9de48eea 2021-07-13T01:05:11.357Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=565e19a7-e207-4f53-ac5e-dcb5e1fc372d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:11.757Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=565e19a7-e207-4f53-ac5e-dcb5e1fc372d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2085 EndTimestamp=2021-07-13T01:05:11.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:09.672Z InvocationID=2951314c-59e1-49c6-bd23-853f1f0fb753 ResponseDesc=OK 2021-07-13T01:05:13.517Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=37e1ac13-c3cb-41f7-81fc-3365a64f26db InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:13.517Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:13.517Z InvocationID=5eb12f2e-a8cc-4585-afaf-e4af6851a7b7 2021-07-13T01:05:13.659Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=37e1ac13-c3cb-41f7-81fc-3365a64f26db InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:14.126Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=37e1ac13-c3cb-41f7-81fc-3365a64f26db InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=609 EndTimestamp=2021-07-13T01:05:14.126Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:13.517Z InvocationID=efa51e25-84c6-4e7e-aa13-af340da2e6cf ResponseDesc=OK 2021-07-13T01:05:15.266Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4954fb9f-733d-4dad-8968-2f732aeb7ceb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:15.266Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:15.266Z InvocationID=329a0c66-373a-4d5f-b7d0-f802f0c7dbbd 2021-07-13T01:05:15.415Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4954fb9f-733d-4dad-8968-2f732aeb7ceb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:15.661Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4954fb9f-733d-4dad-8968-2f732aeb7ceb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=395 EndTimestamp=2021-07-13T01:05:15.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:15.266Z InvocationID=377451f0-7fa0-4d23-ab27-5957562b97fb ResponseDesc=OK 2021-07-13T01:05:16.468Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=38a5292d-6a96-4f35-a1d5-668764fccd03 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:16.468Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:16.468Z InvocationID=eddb2a7f-54e8-4f1b-8452-731157a85d66 2021-07-13T01:05:16.861Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=38a5292d-6a96-4f35-a1d5-668764fccd03 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:17.259Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=38a5292d-6a96-4f35-a1d5-668764fccd03 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=790 EndTimestamp=2021-07-13T01:05:17.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:16.468Z InvocationID=0e4b5392-d9f5-420c-a83c-953dbbb388a0 ResponseDesc=OK 2021-07-13T01:05:17.443Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d72b093-de65-4f93-a260-ab0ae1774aca InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:17.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:17.443Z InvocationID=f818f2f6-51d8-4b80-a9ae-f9ba282242dc 2021-07-13T01:05:17.571Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d72b093-de65-4f93-a260-ab0ae1774aca InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:18.116Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2d72b093-de65-4f93-a260-ab0ae1774aca InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=673 EndTimestamp=2021-07-13T01:05:18.116Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:17.443Z InvocationID=14d45489-5611-4d15-9ea1-dcc175b4b811 ResponseDesc=OK 2021-07-13T01:05:18.577Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8a0afdce-fede-4d1a-b5cc-08fd6b2dc736 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:18.576Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:18.576Z InvocationID=455f7b75-d9bf-4029-884b-41ccadd1782a 2021-07-13T01:05:18.815Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8a0afdce-fede-4d1a-b5cc-08fd6b2dc736 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:18.874Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7e42a27b-f38f-47e9-b290-93935cb71edd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:18.874Z InvocationID=ee8e2a3a-ac6d-4af1-9a88-04454efd4504 2021-07-13T01:05:19.364Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8a0afdce-fede-4d1a-b5cc-08fd6b2dc736 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=787 EndTimestamp=2021-07-13T01:05:19.363Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:18.576Z InvocationID=eb56a601-61ae-4280-813c-3dcefa516f9d ResponseDesc=OK 2021-07-13T01:05:19.556Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7e42a27b-f38f-47e9-b290-93935cb71edd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:20.459Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7e42a27b-f38f-47e9-b290-93935cb71edd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1584 EndTimestamp=2021-07-13T01:05:20.458Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:18.874Z InvocationID=c898ed87-ab8c-437b-94d1-cd721fe75665 ResponseDesc=OK 2021-07-13T01:05:20.665Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b849022d-e739-48f8-ae18-34228f34f0e2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:20.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:20.665Z InvocationID=4025ddea-698f-44ad-a73c-ee67ee27f589 2021-07-13T01:05:20.759Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b849022d-e739-48f8-ae18-34228f34f0e2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:21.626Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b849022d-e739-48f8-ae18-34228f34f0e2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=961 EndTimestamp=2021-07-13T01:05:21.626Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:20.665Z InvocationID=58bbb4d8-a809-4995-9ba3-65c9ca6a44b9 ResponseDesc=OK 2021-07-13T01:05:22.766Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a248ea52-71e0-4510-a369-35d9826aa360 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:22.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:22.765Z InvocationID=ab611175-6d34-4868-8897-1541a8468b2f 2021-07-13T01:05:23.024Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a248ea52-71e0-4510-a369-35d9826aa360 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:23.861Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a248ea52-71e0-4510-a369-35d9826aa360 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1096 EndTimestamp=2021-07-13T01:05:23.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:22.765Z InvocationID=060cfe74-d480-4548-9da0-511b3b64a789 ResponseDesc=OK 2021-07-13T01:05:24.967Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=93976438-7396-4fc9-9e43-8eff0517ba5d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:24.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:24.967Z InvocationID=ed781019-1156-45a5-86b9-822dffdd0845 2021-07-13T01:05:25.258Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=93976438-7396-4fc9-9e43-8eff0517ba5d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:25.657Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=93976438-7396-4fc9-9e43-8eff0517ba5d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=690 EndTimestamp=2021-07-13T01:05:25.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:24.967Z InvocationID=6ebeef78-6b68-45f5-afc7-a8b81ff5391f ResponseDesc=OK 2021-07-13T01:05:26.769Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d6b6c9d-7b4c-4678-bb1d-18aa16d3424b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:26.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:26.769Z InvocationID=dbd3fa11-4822-4c79-91d9-6c4affc59ce2 2021-07-13T01:05:26.860Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d6b6c9d-7b4c-4678-bb1d-18aa16d3424b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:27.213Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d6b6c9d-7b4c-4678-bb1d-18aa16d3424b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=443 EndTimestamp=2021-07-13T01:05:27.212Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:26.769Z InvocationID=fc29fd01-5b49-46ae-a508-b0aeac8be9be ResponseDesc=OK 2021-07-13T01:05:27.440Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=530beb3f-13d0-464e-a5df-f5a482483577 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:27.440Z InvocationID=323ad7d9-f263-4fc0-bd87-ebb052031bb9 2021-07-13T01:05:27.616Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=530beb3f-13d0-464e-a5df-f5a482483577 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:27.860Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=530beb3f-13d0-464e-a5df-f5a482483577 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=420 EndTimestamp=2021-07-13T01:05:27.860Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:27.440Z InvocationID=d677c14d-0354-46ef-b1c6-3fff6c046710 ResponseDesc=OK 2021-07-13T01:05:28.463Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8dfc5b4d-c824-4311-9045-a43d7927c54a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:28.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:28.463Z InvocationID=00c65565-fa87-4b59-b5b3-a59dde8e7021 2021-07-13T01:05:28.560Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8dfc5b4d-c824-4311-9045-a43d7927c54a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:28.874Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=736a095f-5762-4e05-98f7-39d0b75aaff6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:28.874Z InvocationID=2d23446b-7a87-40d0-b125-e8988d69c05c 2021-07-13T01:05:28.959Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8dfc5b4d-c824-4311-9045-a43d7927c54a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=496 EndTimestamp=2021-07-13T01:05:28.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:28.463Z InvocationID=98015527-e562-4ddd-afaa-ad8be15529dd ResponseDesc=OK 2021-07-13T01:05:29.058Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=736a095f-5762-4e05-98f7-39d0b75aaff6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:29.433Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=736a095f-5762-4e05-98f7-39d0b75aaff6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=559 EndTimestamp=2021-07-13T01:05:29.433Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:28.874Z InvocationID=9a1cc70d-18e7-41f0-8826-99d7ed7754d4 ResponseDesc=OK 2021-07-13T01:05:30.634Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8868c86c-d917-4304-8ead-6a2f007a185b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:30.634Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:30.634Z InvocationID=29f055f1-7467-4601-93fa-47a5d3a7adfd 2021-07-13T01:05:34.126Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8868c86c-d917-4304-8ead-6a2f007a185b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:34.594Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8868c86c-d917-4304-8ead-6a2f007a185b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=3960 EndTimestamp=2021-07-13T01:05:34.594Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:30.634Z InvocationID=5e16905f-7c2c-460a-87fb-7516b0d29aa0 ResponseDesc=OK 2021-07-13T01:05:35.092Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3a6ee94f-34d5-4772-b49b-cd6eaefb8460 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:35.092Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:35.092Z InvocationID=6293639f-46fb-426c-9409-26213b891973 2021-07-13T01:05:35.556Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3a6ee94f-34d5-4772-b49b-cd6eaefb8460 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:37.258Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3a6ee94f-34d5-4772-b49b-cd6eaefb8460 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2165 EndTimestamp=2021-07-13T01:05:37.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:35.092Z InvocationID=117c1de9-ea4e-4cff-8656-6645c4b8af45 ResponseDesc=OK 2021-07-13T01:05:37.440Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cbdb410e-8224-44f9-b500-670d80b33ff3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:37.439Z InvocationID=7d915202-b130-4205-8f4b-2e8c2d748dba 2021-07-13T01:05:37.559Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cbdb410e-8224-44f9-b500-670d80b33ff3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:38.874Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d3ede1b9-8efd-4a9d-8418-e354aef6d756 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:38.874Z InvocationID=8e263e8e-2761-4df3-aae7-61c51faf4833 2021-07-13T01:05:40.222Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d3ede1b9-8efd-4a9d-8418-e354aef6d756 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:40.413Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cbdb410e-8224-44f9-b500-670d80b33ff3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2974 EndTimestamp=2021-07-13T01:05:40.413Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:37.439Z InvocationID=26ec56bd-9707-4ce9-a5dd-27eb4345f1a7 ResponseDesc=OK 2021-07-13T01:05:40.462Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d3ede1b9-8efd-4a9d-8418-e354aef6d756 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1588 EndTimestamp=2021-07-13T01:05:40.462Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:38.874Z InvocationID=1cf86433-4012-46e0-b127-b415a6126850 ResponseDesc=OK 2021-07-13T01:05:41.142Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1c9cef32-33f7-4f65-a3bd-4c5cda05c8b7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:41.141Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:41.141Z InvocationID=c3e55324-5bd2-484e-aff9-25bc4ba6e72f 2021-07-13T01:05:41.356Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1c9cef32-33f7-4f65-a3bd-4c5cda05c8b7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:42.259Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1c9cef32-33f7-4f65-a3bd-4c5cda05c8b7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1117 EndTimestamp=2021-07-13T01:05:42.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:41.141Z InvocationID=7b999c0d-980d-4307-9b28-09e18c189a61 ResponseDesc=OK 2021-07-13T01:05:46.336Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=80dbd0cd-1574-459a-bea5-b28db007edd8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:46.336Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:46.336Z InvocationID=b996be22-d369-4143-b5ed-f1b1a49131f2 2021-07-13T01:05:46.977Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=80dbd0cd-1574-459a-bea5-b28db007edd8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:47.441Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce33362d-95e0-45ff-8f39-97146f8b47aa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:47.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:47.441Z InvocationID=99aa1464-a819-482a-ae84-c7ac51d6cbf8 2021-07-13T01:05:48.840Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=80dbd0cd-1574-459a-bea5-b28db007edd8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2504 EndTimestamp=2021-07-13T01:05:48.840Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:46.336Z InvocationID=b4b717f5-c999-401a-b111-844cf5f10253 ResponseDesc=OK 2021-07-13T01:05:48.876Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b2f5d32a-023f-43bb-a600-5b1f5b9087c1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:48.875Z InvocationID=7f4e82ef-219e-4ca4-a63c-9215b837fc4f 2021-07-13T01:05:49.359Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b2f5d32a-023f-43bb-a600-5b1f5b9087c1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:49.413Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce33362d-95e0-45ff-8f39-97146f8b47aa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:49.562Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b2f5d32a-023f-43bb-a600-5b1f5b9087c1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=687 EndTimestamp=2021-07-13T01:05:49.562Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:48.875Z InvocationID=d71252b6-1ab2-4f53-85df-b16d55dc1318 ResponseDesc=OK 2021-07-13T01:05:49.757Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ce33362d-95e0-45ff-8f39-97146f8b47aa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2316 EndTimestamp=2021-07-13T01:05:49.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:47.441Z InvocationID=aedc0748-7d9b-47d8-bb2e-64c1b833f2fc ResponseDesc=OK 2021-07-13T01:05:51.339Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=216d2e82-f28f-43ed-9d79-69fb169f6437 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:51.339Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:51.339Z InvocationID=54e4140b-a40b-4e90-b124-9398abf97eea 2021-07-13T01:05:51.459Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=216d2e82-f28f-43ed-9d79-69fb169f6437 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:52.912Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=216d2e82-f28f-43ed-9d79-69fb169f6437 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1573 EndTimestamp=2021-07-13T01:05:52.912Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:51.339Z InvocationID=7da2bc33-2440-4bf5-b5fd-6c2b6a0b4224 ResponseDesc=OK 2021-07-13T01:05:54.028Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1a57f7e0-f655-4fab-8eb8-b51dadea67fa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:54.028Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:54.028Z InvocationID=2dd4b2ce-3558-4f9e-908c-5feaaa036539 2021-07-13T01:05:54.943Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1a57f7e0-f655-4fab-8eb8-b51dadea67fa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:55.161Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1a57f7e0-f655-4fab-8eb8-b51dadea67fa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1132 EndTimestamp=2021-07-13T01:05:55.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:54.028Z InvocationID=018034c9-f387-46b8-ba5e-fa878b8fc72a ResponseDesc=OK 2021-07-13T01:05:56.422Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=27344a42-0a7d-47fe-9875-84c3040c0145 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:56.422Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:56.422Z InvocationID=c42f7a9a-a56d-4817-84b1-3d3bc4b0b687 2021-07-13T01:05:56.557Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=27344a42-0a7d-47fe-9875-84c3040c0145 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:56.958Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=27344a42-0a7d-47fe-9875-84c3040c0145 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=536 EndTimestamp=2021-07-13T01:05:56.958Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:56.422Z InvocationID=1ff2fae7-f0f9-4e1f-9ad4-c9a309ccaca8 ResponseDesc=OK 2021-07-13T01:05:57.446Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=761ba15e-efa2-4b8a-ad3d-32638d3fab28 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:57.446Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:57.446Z InvocationID=4039121a-0e40-4b2f-9cf3-dc659a24ceb1 2021-07-13T01:05:57.559Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=761ba15e-efa2-4b8a-ad3d-32638d3fab28 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:58.013Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=761ba15e-efa2-4b8a-ad3d-32638d3fab28 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=567 EndTimestamp=2021-07-13T01:05:58.013Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:57.446Z InvocationID=20656d45-527f-4a6a-87ce-97c5e6b51755 ResponseDesc=OK 2021-07-13T01:05:58.530Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fe79b4a2-261b-4af5-bba1-466becd54dab InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:58.530Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:58.530Z InvocationID=bacbb5b7-de00-4f27-ba1a-22bf4944655a 2021-07-13T01:05:58.721Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fe79b4a2-261b-4af5-bba1-466becd54dab InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:58.875Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=32916ded-bbc3-45a6-a216-8c4168568c2f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:05:58.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:58.875Z InvocationID=35a3dd88-1256-4275-a46f-3658fc83e2bd 2021-07-13T01:05:58.964Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fe79b4a2-261b-4af5-bba1-466becd54dab InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=434 EndTimestamp=2021-07-13T01:05:58.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:58.530Z InvocationID=67ca47ad-d566-40bb-afc6-32a13c72b47f ResponseDesc=OK 2021-07-13T01:05:59.058Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=32916ded-bbc3-45a6-a216-8c4168568c2f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:05:59.858Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=32916ded-bbc3-45a6-a216-8c4168568c2f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=983 EndTimestamp=2021-07-13T01:05:59.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:05:58.875Z InvocationID=2e695c56-41e5-46a0-a1f9-93fbbae549ac ResponseDesc=OK 2021-07-13T01:06:00.325Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=72aa0f96-72a0-4baa-83f7-5b753cafcb9d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:00.324Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:00.324Z InvocationID=3272a09b-197c-4f55-8d5d-b66140df47d4 2021-07-13T01:06:00.560Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=72aa0f96-72a0-4baa-83f7-5b753cafcb9d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:00.916Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=72aa0f96-72a0-4baa-83f7-5b753cafcb9d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=591 EndTimestamp=2021-07-13T01:06:00.915Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:00.324Z InvocationID=ba15a279-aea9-4641-b606-4244940b55c3 ResponseDesc=OK 2021-07-13T01:06:01.864Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5da5423c-b128-44dc-b7dc-8b65d753164e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:01.864Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:01.864Z InvocationID=942d2689-7eda-41f1-a4cd-985348fd2658 2021-07-13T01:06:02.612Z [qtp817348612-18] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5da5423c-b128-44dc-b7dc-8b65d753164e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:03.262Z [qtp817348612-18] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5da5423c-b128-44dc-b7dc-8b65d753164e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1398 EndTimestamp=2021-07-13T01:06:03.262Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:01.864Z InvocationID=ba569e6e-5a20-4678-8d27-9d3a74733a0c ResponseDesc=OK 2021-07-13T01:06:04.368Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=29af7802-a593-46c5-b763-c0cb207633d3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:04.367Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:04.367Z InvocationID=b414140d-0a4d-4461-aa51-fcec0962b21e 2021-07-13T01:06:04.557Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=29af7802-a593-46c5-b763-c0cb207633d3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:04.967Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=29af7802-a593-46c5-b763-c0cb207633d3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=600 EndTimestamp=2021-07-13T01:06:04.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:04.367Z InvocationID=89657d9f-502a-484d-bcd2-00212301a261 ResponseDesc=OK 2021-07-13T01:06:06.065Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e809a5a9-41cd-481c-8912-bd09588301e4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:06.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:06.064Z InvocationID=e840f05a-184d-4ef7-93e1-4dd0ee0b612a 2021-07-13T01:06:06.159Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e809a5a9-41cd-481c-8912-bd09588301e4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:06.518Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e809a5a9-41cd-481c-8912-bd09588301e4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=454 EndTimestamp=2021-07-13T01:06:06.518Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:06.064Z InvocationID=571961f3-35ee-4a6b-bd2c-ccdcefcfebae ResponseDesc=OK 2021-07-13T01:06:07.289Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=05cec689-40b7-4d96-a03b-33de82c4bd83 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:07.289Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:07.289Z InvocationID=82fd1145-4116-425e-b652-96d075a81738 2021-07-13T01:06:07.441Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9a5d718-279e-44f3-84c8-43f65998b2c0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:07.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:07.441Z InvocationID=f4679f78-6121-4406-9c58-e51924f0e3ad 2021-07-13T01:06:07.864Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b9a5d718-279e-44f3-84c8-43f65998b2c0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:08.316Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=05cec689-40b7-4d96-a03b-33de82c4bd83 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:08.362Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b9a5d718-279e-44f3-84c8-43f65998b2c0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=921 EndTimestamp=2021-07-13T01:06:08.362Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:07.441Z InvocationID=3f2332fe-6c7b-40bb-b05c-6c4ea7a9787b ResponseDesc=OK 2021-07-13T01:06:08.658Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=05cec689-40b7-4d96-a03b-33de82c4bd83 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1369 EndTimestamp=2021-07-13T01:06:08.658Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:07.289Z InvocationID=cd504bc7-206f-40e9-b356-532efe1f1a9c ResponseDesc=OK 2021-07-13T01:06:08.875Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b0a0cb5a-d7eb-4841-986c-66cdb83ef6e3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:08.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:08.875Z InvocationID=f895016f-ebd5-42ec-ae29-8bceb711ed7f 2021-07-13T01:06:09.059Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b0a0cb5a-d7eb-4841-986c-66cdb83ef6e3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:09.417Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b0a0cb5a-d7eb-4841-986c-66cdb83ef6e3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=542 EndTimestamp=2021-07-13T01:06:09.417Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:08.875Z InvocationID=1801a2ab-37eb-4e32-9949-b26a624ce5ef ResponseDesc=OK 2021-07-13T01:06:09.763Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=178776b3-c11a-42b6-a84e-3104123cd77f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:09.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:09.763Z InvocationID=6e20da5f-641d-4413-aed2-f816d69fd428 2021-07-13T01:06:09.947Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=178776b3-c11a-42b6-a84e-3104123cd77f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:10.260Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=178776b3-c11a-42b6-a84e-3104123cd77f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=497 EndTimestamp=2021-07-13T01:06:10.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:09.763Z InvocationID=25241930-cbb7-4c61-8e63-12b21381717c ResponseDesc=OK 2021-07-13T01:06:11.363Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7d590457-dc07-47d6-a670-ac44c254dcc6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:11.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:11.362Z InvocationID=0c2458ee-977d-4d2e-adb8-95568e4c7971 2021-07-13T01:06:11.457Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7d590457-dc07-47d6-a670-ac44c254dcc6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:11.858Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7d590457-dc07-47d6-a670-ac44c254dcc6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=496 EndTimestamp=2021-07-13T01:06:11.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:11.362Z InvocationID=7a06dfd2-592a-4d30-ac0b-785bb972ee9e ResponseDesc=OK 2021-07-13T01:06:12.967Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7767c4d0-2e67-4b4d-9ab8-af07de0dd359 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:12.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:12.966Z InvocationID=569d1f8d-b5eb-4c57-8397-5065bda9af7c 2021-07-13T01:06:13.060Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7767c4d0-2e67-4b4d-9ab8-af07de0dd359 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:13.167Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7767c4d0-2e67-4b4d-9ab8-af07de0dd359 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=201 EndTimestamp=2021-07-13T01:06:13.167Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:12.966Z InvocationID=ebb4bc8d-5f79-4431-862d-4cad6c7490e2 ResponseDesc=OK 2021-07-13T01:06:14.371Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=156db217-3ae0-4efb-b6de-ab4d55567d04 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:14.371Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:14.371Z InvocationID=64e13780-b07b-42d3-82a1-368e219218a3 2021-07-13T01:06:14.560Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=156db217-3ae0-4efb-b6de-ab4d55567d04 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:14.764Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=156db217-3ae0-4efb-b6de-ab4d55567d04 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=393 EndTimestamp=2021-07-13T01:06:14.764Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:14.371Z InvocationID=847d0f98-2efd-4230-85d7-5eb37119014e ResponseDesc=OK 2021-07-13T01:06:15.561Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f1c2c4bd-c0c5-4293-81c7-fdc1f078a077 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:15.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:15.560Z InvocationID=e36a50a6-8826-4b53-8d3a-2cfde07c4666 2021-07-13T01:06:15.756Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f1c2c4bd-c0c5-4293-81c7-fdc1f078a077 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:16.058Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f1c2c4bd-c0c5-4293-81c7-fdc1f078a077 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=498 EndTimestamp=2021-07-13T01:06:16.058Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:15.560Z InvocationID=fa63e817-d0a7-4001-af1c-0515c375ff77 ResponseDesc=OK 2021-07-13T01:06:17.369Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eaac26c5-9b3b-46bc-8c9e-de6411063a2f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:17.369Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:17.369Z InvocationID=0077a2b2-4bc2-4fbd-87ef-ff41b7bf2742 2021-07-13T01:06:17.442Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8abd997f-8e1c-425d-9312-e9425e20c256 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:17.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:17.442Z InvocationID=3ae1d992-45c0-4fa3-99b0-37d7f2692ae6 2021-07-13T01:06:17.556Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8abd997f-8e1c-425d-9312-e9425e20c256 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:17.558Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eaac26c5-9b3b-46bc-8c9e-de6411063a2f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:17.916Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eaac26c5-9b3b-46bc-8c9e-de6411063a2f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=547 EndTimestamp=2021-07-13T01:06:17.916Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:17.369Z InvocationID=3d3d693e-dd82-40d1-876d-0d085391af85 ResponseDesc=OK 2021-07-13T01:06:17.959Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8abd997f-8e1c-425d-9312-e9425e20c256 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=517 EndTimestamp=2021-07-13T01:06:17.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:17.442Z InvocationID=f82ea894-9ada-469b-a6ac-078b29c75461 ResponseDesc=OK 2021-07-13T01:06:18.875Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a1c1de94-a757-4344-bc12-d176172141e5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:18.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:18.875Z InvocationID=25f2be51-c7c9-4285-b3b3-959122024c07 2021-07-13T01:06:19.057Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a1c1de94-a757-4344-bc12-d176172141e5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:19.076Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2bc05158-4fbf-4574-82ca-edd600ba33e1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:19.075Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:19.075Z InvocationID=d2513dd6-b6a4-4f51-acb0-0824561c2052 2021-07-13T01:06:19.161Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2bc05158-4fbf-4574-82ca-edd600ba33e1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:19.558Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2bc05158-4fbf-4574-82ca-edd600ba33e1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=482 EndTimestamp=2021-07-13T01:06:19.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:19.075Z InvocationID=e768ff2f-9cc0-4229-aa97-832b28a1cb61 ResponseDesc=OK 2021-07-13T01:06:19.729Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a1c1de94-a757-4344-bc12-d176172141e5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=854 EndTimestamp=2021-07-13T01:06:19.729Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:18.875Z InvocationID=fd17d4d2-0f1c-4695-842e-ad0a6526621f ResponseDesc=OK 2021-07-13T01:06:20.972Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=201769d6-8e09-4ad2-a424-35859e745277 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:20.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:20.972Z InvocationID=ae5d726f-7a8d-4ab5-91f3-c3ca53b2933c 2021-07-13T01:06:21.222Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=201769d6-8e09-4ad2-a424-35859e745277 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:21.562Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=201769d6-8e09-4ad2-a424-35859e745277 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=590 EndTimestamp=2021-07-13T01:06:21.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:20.972Z InvocationID=4bb18b1c-b1d1-4030-93bd-aee6ea9b96ad ResponseDesc=OK 2021-07-13T01:06:24.271Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ed9f2b7b-4e04-4371-aee4-d884764082f1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:24.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:24.271Z InvocationID=2a0d0b19-863c-4a4d-a48a-8e502d3e0b39 2021-07-13T01:06:24.558Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ed9f2b7b-4e04-4371-aee4-d884764082f1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:24.858Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ed9f2b7b-4e04-4371-aee4-d884764082f1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=587 EndTimestamp=2021-07-13T01:06:24.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:24.271Z InvocationID=5dc90a13-90f6-4f45-8f8e-314fa5220bea ResponseDesc=OK 2021-07-13T01:06:26.863Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6c457562-b5c3-49b2-83dd-087d9de1e1d8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:26.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:26.863Z InvocationID=dd91404f-640e-49be-8f12-ff3a59be2b48 2021-07-13T01:06:27.060Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6c457562-b5c3-49b2-83dd-087d9de1e1d8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:27.313Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6c457562-b5c3-49b2-83dd-087d9de1e1d8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=450 EndTimestamp=2021-07-13T01:06:27.313Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:26.863Z InvocationID=47df2407-54ae-46cc-aaf4-d597dd6962db ResponseDesc=OK 2021-07-13T01:06:27.440Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8d857652-e98f-478d-aa6a-fbd979042426 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:27.440Z InvocationID=ebda6f52-956b-4265-8f38-2c2cb8a94a81 2021-07-13T01:06:27.612Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8d857652-e98f-478d-aa6a-fbd979042426 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:27.961Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8d857652-e98f-478d-aa6a-fbd979042426 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=520 EndTimestamp=2021-07-13T01:06:27.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:27.440Z InvocationID=a7366c86-37f7-4ada-95fe-a71d0e4d2233 ResponseDesc=OK 2021-07-13T01:06:28.874Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=45cb40ac-50e1-4dd1-8f9c-8148be6921a9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:28.874Z InvocationID=4ece73ec-b490-437f-96b9-5c90edd350ab 2021-07-13T01:06:29.060Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=45cb40ac-50e1-4dd1-8f9c-8148be6921a9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:29.465Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=45cb40ac-50e1-4dd1-8f9c-8148be6921a9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=591 EndTimestamp=2021-07-13T01:06:29.465Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:28.874Z InvocationID=1d8a1bb0-bc38-4328-9672-52718be6bf9e ResponseDesc=OK 2021-07-13T01:06:29.928Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=275a623d-0699-4353-a376-fa2c2f710f3d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:29.928Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:29.928Z InvocationID=d96f012d-54d6-48b4-9d15-60d89eb251c7 2021-07-13T01:06:30.059Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=275a623d-0699-4353-a376-fa2c2f710f3d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:30.414Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=275a623d-0699-4353-a376-fa2c2f710f3d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=485 EndTimestamp=2021-07-13T01:06:30.413Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:29.928Z InvocationID=17c771be-b07f-491a-9a8c-14d60f029887 ResponseDesc=OK 2021-07-13T01:06:32.766Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b2aae249-20a3-4995-a245-73d63dc76528 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:32.766Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:32.766Z InvocationID=5ca2859c-72af-42c9-b386-a5565657248c 2021-07-13T01:06:32.922Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b2aae249-20a3-4995-a245-73d63dc76528 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:34.661Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b2aae249-20a3-4995-a245-73d63dc76528 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1895 EndTimestamp=2021-07-13T01:06:34.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:32.766Z InvocationID=13eab30b-7020-40cb-abea-a43d30dc2f48 ResponseDesc=OK 2021-07-13T01:06:35.578Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c08c7132-ac53-4e6e-921c-9930aab83d40 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:35.578Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:35.578Z InvocationID=a00f6ff1-a3de-4523-a4cb-1dd8237e65a3 2021-07-13T01:06:35.756Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c08c7132-ac53-4e6e-921c-9930aab83d40 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:36.861Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c08c7132-ac53-4e6e-921c-9930aab83d40 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1282 EndTimestamp=2021-07-13T01:06:36.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:35.578Z InvocationID=a0b43881-730e-42b5-ac06-9428803159a9 ResponseDesc=OK 2021-07-13T01:06:37.440Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cdacef93-dcad-4997-9f03-46159a49fb8f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:37.440Z InvocationID=bfe4db73-6115-4182-b4c2-4fcd71bfa826 2021-07-13T01:06:37.559Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cdacef93-dcad-4997-9f03-46159a49fb8f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:38.295Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cdacef93-dcad-4997-9f03-46159a49fb8f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=855 EndTimestamp=2021-07-13T01:06:38.295Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:37.440Z InvocationID=2a92512d-9c73-4daf-82ce-45551f9d1ac2 ResponseDesc=OK 2021-07-13T01:06:38.875Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=87d40be1-3ed9-4133-a8fb-29d03a028ee8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:38.874Z InvocationID=7565ae42-025c-4ad0-b72a-5e3a33ec59d8 2021-07-13T01:06:39.016Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=87d40be1-3ed9-4133-a8fb-29d03a028ee8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:39.168Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=50918072-8c02-40be-8d50-47069a808534 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:39.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:39.168Z InvocationID=d814c846-1cd4-486e-aa06-9ae5e070d749 2021-07-13T01:06:39.261Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=87d40be1-3ed9-4133-a8fb-29d03a028ee8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=387 EndTimestamp=2021-07-13T01:06:39.261Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:38.874Z InvocationID=d989e849-3bc9-44af-8b92-7a883a467866 ResponseDesc=OK 2021-07-13T01:06:39.357Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=50918072-8c02-40be-8d50-47069a808534 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:40.857Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=50918072-8c02-40be-8d50-47069a808534 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1689 EndTimestamp=2021-07-13T01:06:40.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:39.168Z InvocationID=dd08e4aa-a61f-448b-bdc7-b9a9406c91b4 ResponseDesc=OK 2021-07-13T01:06:41.773Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=223aa025-384f-4b4b-bda4-9f584d81579c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:41.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:41.772Z InvocationID=6e760d8a-b7c2-4075-bd5d-df43d7372c69 2021-07-13T01:06:42.058Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=223aa025-384f-4b4b-bda4-9f584d81579c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:42.431Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=223aa025-384f-4b4b-bda4-9f584d81579c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=659 EndTimestamp=2021-07-13T01:06:42.431Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:41.772Z InvocationID=ca9dd0c3-587b-48b2-9539-58d9a31c4b6f ResponseDesc=OK 2021-07-13T01:06:45.165Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1c03c389-2edb-4b0a-91e6-3dd58de30c96 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:45.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:45.164Z InvocationID=54a1a8c4-f82d-4345-8690-e9f87617052d 2021-07-13T01:06:45.419Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1c03c389-2edb-4b0a-91e6-3dd58de30c96 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:45.560Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1c03c389-2edb-4b0a-91e6-3dd58de30c96 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=396 EndTimestamp=2021-07-13T01:06:45.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:45.164Z InvocationID=e11e5ecc-d96f-4620-ae27-504bf0d6f9d7 ResponseDesc=OK 2021-07-13T01:06:47.439Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ccce601f-0f5b-43ce-9f6b-a36b2a285182 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:47.439Z InvocationID=f35abf1f-e83a-49bd-9a75-fdd9e34cd6db 2021-07-13T01:06:47.568Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ccce601f-0f5b-43ce-9f6b-a36b2a285182 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:47.768Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=294158a6-5299-41ed-bf74-7b96975a6b80 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:47.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:47.768Z InvocationID=a6e22049-e387-400b-9c07-28680ed5f13b 2021-07-13T01:06:48.058Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=294158a6-5299-41ed-bf74-7b96975a6b80 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:48.258Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ccce601f-0f5b-43ce-9f6b-a36b2a285182 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=819 EndTimestamp=2021-07-13T01:06:48.258Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:47.439Z InvocationID=fea700d8-b16b-48e3-b94f-8f44b48cc90f ResponseDesc=OK 2021-07-13T01:06:48.537Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=294158a6-5299-41ed-bf74-7b96975a6b80 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=768 EndTimestamp=2021-07-13T01:06:48.536Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:47.768Z InvocationID=55795293-4aa1-4628-9ef7-2899e1ce83cf ResponseDesc=OK 2021-07-13T01:06:48.874Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c0b63c1b-84ef-4a6e-869c-1d684316f4a9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:48.873Z InvocationID=f8125f4b-4ef3-4c8d-a2af-4d7ef1b21062 2021-07-13T01:06:49.113Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c0b63c1b-84ef-4a6e-869c-1d684316f4a9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:49.360Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c0b63c1b-84ef-4a6e-869c-1d684316f4a9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=487 EndTimestamp=2021-07-13T01:06:49.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:48.873Z InvocationID=9cd1fcd6-de57-4d90-9fe2-d99ae245367b ResponseDesc=OK 2021-07-13T01:06:50.968Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=373d1ccc-ad1e-4ab9-bf17-b18d1ea0d90a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:50.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:50.968Z InvocationID=6bcabc61-6bea-480c-93db-9082d4e58fb3 2021-07-13T01:06:51.157Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=373d1ccc-ad1e-4ab9-bf17-b18d1ea0d90a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:51.363Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=373d1ccc-ad1e-4ab9-bf17-b18d1ea0d90a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=395 EndTimestamp=2021-07-13T01:06:51.363Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:50.968Z InvocationID=03ffbe0d-cd2e-4735-85f7-233267d014de ResponseDesc=OK 2021-07-13T01:06:54.067Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0af14ae6-8198-4295-9a44-e0ab1412fc78 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:54.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:54.067Z InvocationID=bb4100b0-63a6-457f-acca-099a57d153a7 2021-07-13T01:06:54.358Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0af14ae6-8198-4295-9a44-e0ab1412fc78 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:54.718Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0af14ae6-8198-4295-9a44-e0ab1412fc78 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=651 EndTimestamp=2021-07-13T01:06:54.718Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:54.067Z InvocationID=33ac59fc-0ad4-4a51-9489-43e3bb92071d ResponseDesc=OK 2021-07-13T01:06:56.824Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=26f23189-e7c0-444f-b616-32f7c5bb43fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:56.823Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:56.823Z InvocationID=abf93309-3db9-4aeb-bb82-46b1f52c86ff 2021-07-13T01:06:57.015Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=26f23189-e7c0-444f-b616-32f7c5bb43fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:57.261Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=26f23189-e7c0-444f-b616-32f7c5bb43fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=438 EndTimestamp=2021-07-13T01:06:57.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:56.823Z InvocationID=2c240ebd-6fdb-4d0b-81d9-730df7685b69 ResponseDesc=OK 2021-07-13T01:06:57.440Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=acb8c24d-8511-42be-955c-1600f527f6b6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:57.439Z InvocationID=87b6e944-6673-4892-9555-7bd847bd4a37 2021-07-13T01:06:57.557Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=acb8c24d-8511-42be-955c-1600f527f6b6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:58.457Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=acb8c24d-8511-42be-955c-1600f527f6b6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1018 EndTimestamp=2021-07-13T01:06:58.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:57.439Z InvocationID=8c56635b-7dd0-4dd7-b86e-19cc4538ed02 ResponseDesc=OK 2021-07-13T01:06:58.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b6a8ccbb-92b6-4c44-ad8e-2512c8161bab InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:06:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:58.874Z InvocationID=4551809b-2f52-407e-95e8-959c690868fc 2021-07-13T01:06:59.059Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b6a8ccbb-92b6-4c44-ad8e-2512c8161bab InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:06:59.916Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b6a8ccbb-92b6-4c44-ad8e-2512c8161bab InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1042 EndTimestamp=2021-07-13T01:06:59.916Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:06:58.874Z InvocationID=23bd9568-65ea-4922-a129-2eb76f97551d ResponseDesc=OK 2021-07-13T01:07:00.061Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ec81048a-6a8e-43d9-9d7f-3fda6584a8fa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:00.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:00.060Z InvocationID=dda34699-4224-4776-8010-d2bea0e9170b 2021-07-13T01:07:00.926Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ec81048a-6a8e-43d9-9d7f-3fda6584a8fa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:01.171Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ec81048a-6a8e-43d9-9d7f-3fda6584a8fa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1110 EndTimestamp=2021-07-13T01:07:01.170Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:00.060Z InvocationID=002085d4-dcfb-497d-826b-06193373a4c7 ResponseDesc=OK 2021-07-13T01:07:02.969Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a7408c9e-b5d0-498e-96df-4308397a4c1e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:02.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:02.968Z InvocationID=b0f24ee2-a929-4bde-a1a1-f783d7b6b823 2021-07-13T01:07:03.158Z [qtp817348612-50] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a7408c9e-b5d0-498e-96df-4308397a4c1e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:03.575Z [qtp817348612-50] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a7408c9e-b5d0-498e-96df-4308397a4c1e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=607 EndTimestamp=2021-07-13T01:07:03.575Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:02.968Z InvocationID=385454fc-2598-4996-a176-b9a38456c1f3 ResponseDesc=OK 2021-07-13T01:07:06.654Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3f80fdf5-77b0-48e0-98b3-f50102e59e2b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:06.654Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:06.654Z InvocationID=e24a1013-0dba-4ac7-a266-df70b4c48be6 2021-07-13T01:07:06.760Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3f80fdf5-77b0-48e0-98b3-f50102e59e2b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:07.441Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2f02a643-e973-4990-b336-8d6b8f9299fb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:07.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:07.441Z InvocationID=9899d754-f1c6-4171-a31b-e507f1533fae 2021-07-13T01:07:07.722Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2f02a643-e973-4990-b336-8d6b8f9299fb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:07.724Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3f80fdf5-77b0-48e0-98b3-f50102e59e2b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1070 EndTimestamp=2021-07-13T01:07:07.724Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:06.654Z InvocationID=78347443-dd14-438c-8cf3-f1e38cb8e0df ResponseDesc=OK 2021-07-13T01:07:07.961Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2f02a643-e973-4990-b336-8d6b8f9299fb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=519 EndTimestamp=2021-07-13T01:07:07.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:07.441Z InvocationID=b9dcb84f-ff4e-4f44-9d17-f42cd9f62f09 ResponseDesc=OK 2021-07-13T01:07:08.687Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aafbf3ec-2ef6-4e1e-a771-6fca7da2192e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:08.687Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:08.687Z InvocationID=05a64d62-be4f-4ec2-b071-5f4aeb5d8c34 2021-07-13T01:07:08.858Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aafbf3ec-2ef6-4e1e-a771-6fca7da2192e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:08.874Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9b8cd1de-5f02-4637-81aa-ee704fdccda8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:08.874Z InvocationID=ff646005-5fa7-4cd8-ad20-5b8eb58e9051 2021-07-13T01:07:09.059Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9b8cd1de-5f02-4637-81aa-ee704fdccda8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:09.358Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aafbf3ec-2ef6-4e1e-a771-6fca7da2192e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=671 EndTimestamp=2021-07-13T01:07:09.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:08.687Z InvocationID=996e599a-7916-4695-a803-9690c24fe156 ResponseDesc=OK 2021-07-13T01:07:09.517Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9b8cd1de-5f02-4637-81aa-ee704fdccda8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=643 EndTimestamp=2021-07-13T01:07:09.517Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:08.874Z InvocationID=3b3edeee-a8c4-460f-baed-e1e22fbcfcdc ResponseDesc=OK 2021-07-13T01:07:11.960Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=17c81457-7b49-4ba2-a039-68663895929c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:11.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:11.960Z InvocationID=93265d88-b9d0-4d63-90e6-ce2ab880de1b 2021-07-13T01:07:12.210Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=17c81457-7b49-4ba2-a039-68663895929c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:12.461Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=17c81457-7b49-4ba2-a039-68663895929c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=501 EndTimestamp=2021-07-13T01:07:12.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:11.960Z InvocationID=c23ad19d-dbab-4cb2-b7dd-4e03cb207e28 ResponseDesc=OK 2021-07-13T01:07:14.874Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b145f661-3058-4a83-a2ec-d09af3844aa9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:14.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:14.873Z InvocationID=9e477f2a-3aa2-4d79-8d6f-fd8e0853d1a6 2021-07-13T01:07:15.056Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b145f661-3058-4a83-a2ec-d09af3844aa9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:15.269Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b145f661-3058-4a83-a2ec-d09af3844aa9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=395 EndTimestamp=2021-07-13T01:07:15.268Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:14.873Z InvocationID=a616a0ef-825c-46e6-87cf-48753fc0f1e5 ResponseDesc=OK 2021-07-13T01:07:17.443Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d085386a-cb2d-4448-852b-80810bc55b60 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:17.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:17.443Z InvocationID=44f95276-c68b-4381-844f-ef84a5c07625 2021-07-13T01:07:17.560Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d085386a-cb2d-4448-852b-80810bc55b60 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:17.770Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d085386a-cb2d-4448-852b-80810bc55b60 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=327 EndTimestamp=2021-07-13T01:07:17.770Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:17.443Z InvocationID=cc2c024c-101b-42f4-845c-4041befa6ec6 ResponseDesc=OK 2021-07-13T01:07:18.074Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0c5e9964-1629-4640-8e4d-a7c26113af5b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:18.074Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:18.074Z InvocationID=280e6639-f6e7-459c-96d8-9cd22a05b00d 2021-07-13T01:07:18.398Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0c5e9964-1629-4640-8e4d-a7c26113af5b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:18.567Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0c5e9964-1629-4640-8e4d-a7c26113af5b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=493 EndTimestamp=2021-07-13T01:07:18.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:18.074Z InvocationID=1267cf25-ef0b-4df4-8d9e-b616359312aa ResponseDesc=OK 2021-07-13T01:07:18.874Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3bee2dab-8d0b-44c4-8a05-1dea827177c4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:18.874Z InvocationID=8406b20e-2851-46da-9544-6830c2bb2a76 2021-07-13T01:07:18.957Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3bee2dab-8d0b-44c4-8a05-1dea827177c4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:19.465Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3bee2dab-8d0b-44c4-8a05-1dea827177c4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=591 EndTimestamp=2021-07-13T01:07:19.465Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:18.874Z InvocationID=e7aeacdd-cf6b-4bd7-86e0-f689b0c9de02 ResponseDesc=OK 2021-07-13T01:07:20.866Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a8dfdc22-974c-4c2d-a970-ad7cbcb5071e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:20.866Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:20.866Z InvocationID=f59275a5-9716-4ea2-9279-728630791541 2021-07-13T01:07:20.963Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a8dfdc22-974c-4c2d-a970-ad7cbcb5071e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:22.062Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a8dfdc22-974c-4c2d-a970-ad7cbcb5071e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1196 EndTimestamp=2021-07-13T01:07:22.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:20.866Z InvocationID=062100f9-4b6c-4d45-ba6f-8437ae903f1c ResponseDesc=OK 2021-07-13T01:07:23.773Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=28ee6283-c84f-4db0-a624-68a1aeb143e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:23.773Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:23.773Z InvocationID=4bceba1e-61b4-4960-83d8-86cce8a76cd6 2021-07-13T01:07:23.961Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=28ee6283-c84f-4db0-a624-68a1aeb143e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:24.164Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=28ee6283-c84f-4db0-a624-68a1aeb143e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=390 EndTimestamp=2021-07-13T01:07:24.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:23.773Z InvocationID=2ef74433-6f49-4da8-af32-4855f703b984 ResponseDesc=OK 2021-07-13T01:07:27.063Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dca7944a-5252-42fb-a84f-1512baaf9d05 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:27.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:27.063Z InvocationID=3294e404-bd70-4b94-8210-f75a9091fcaf 2021-07-13T01:07:27.159Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dca7944a-5252-42fb-a84f-1512baaf9d05 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:27.381Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dca7944a-5252-42fb-a84f-1512baaf9d05 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=318 EndTimestamp=2021-07-13T01:07:27.381Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:27.063Z InvocationID=959f4c78-6abb-40c2-835a-3ba4fce61ded ResponseDesc=OK 2021-07-13T01:07:27.442Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e852178e-ca0d-41eb-974f-b3698c31cea6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:27.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:27.442Z InvocationID=74f98567-95dd-4256-b018-f8edef021041 2021-07-13T01:07:27.759Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e852178e-ca0d-41eb-974f-b3698c31cea6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:28.026Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e852178e-ca0d-41eb-974f-b3698c31cea6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=584 EndTimestamp=2021-07-13T01:07:28.026Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:27.442Z InvocationID=2ef4b96c-b04c-4412-90b2-b09877970cbc ResponseDesc=OK 2021-07-13T01:07:28.874Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a43209da-e6d8-405b-a9ce-bc6f85c8cccd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:28.874Z InvocationID=8be6a10b-2387-41b9-90f1-cc64689eb4e8 2021-07-13T01:07:29.498Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a43209da-e6d8-405b-a9ce-bc6f85c8cccd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:29.760Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a43209da-e6d8-405b-a9ce-bc6f85c8cccd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=885 EndTimestamp=2021-07-13T01:07:29.759Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:28.874Z InvocationID=d1ba8654-7848-4ada-a1b9-7a27c5c27bb3 ResponseDesc=OK 2021-07-13T01:07:30.160Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c019a2e3-7db7-4a8e-bd14-493fa5c75499 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:30.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:30.160Z InvocationID=dd1f75f5-c5e1-4243-8fbf-109a7d802d28 2021-07-13T01:07:30.257Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c019a2e3-7db7-4a8e-bd14-493fa5c75499 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:34.857Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c019a2e3-7db7-4a8e-bd14-493fa5c75499 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=4697 EndTimestamp=2021-07-13T01:07:34.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:30.160Z InvocationID=5736efaa-9e1c-4b21-b2e7-238e6e0455ed ResponseDesc=OK 2021-07-13T01:07:35.511Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=721a7097-5453-4233-a52b-3fa5ae001655 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:35.511Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:35.511Z InvocationID=0d054a52-146a-44e7-aac8-d5f6093ec2e2 2021-07-13T01:07:35.658Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=721a7097-5453-4233-a52b-3fa5ae001655 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:36.061Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=721a7097-5453-4233-a52b-3fa5ae001655 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=550 EndTimestamp=2021-07-13T01:07:36.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:35.511Z InvocationID=4bab89df-3ba7-45c1-b417-842151d9540e ResponseDesc=OK 2021-07-13T01:07:36.971Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0dfa6079-4eca-41a3-b058-845e81b12d3f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:36.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:36.971Z InvocationID=b7220b80-cf7e-4060-8c1c-c7d40f5b79c5 2021-07-13T01:07:37.347Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0dfa6079-4eca-41a3-b058-845e81b12d3f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:37.439Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f3104904-975b-49a8-97f3-2abefcd91af8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:37.439Z InvocationID=2bdbb56f-f9e6-43a8-b628-3b75b24df50e 2021-07-13T01:07:37.620Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0dfa6079-4eca-41a3-b058-845e81b12d3f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=648 EndTimestamp=2021-07-13T01:07:37.619Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:36.971Z InvocationID=c3066df4-6af2-4579-a37b-89b483f20a61 ResponseDesc=OK 2021-07-13T01:07:37.656Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f3104904-975b-49a8-97f3-2abefcd91af8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:37.958Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f3104904-975b-49a8-97f3-2abefcd91af8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=518 EndTimestamp=2021-07-13T01:07:37.957Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:37.439Z InvocationID=db8121a1-32da-4d23-8d57-036778075aa1 ResponseDesc=OK 2021-07-13T01:07:38.667Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=556339b7-d7ba-422e-ad5d-b05babd38ee0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:38.667Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:38.667Z InvocationID=193f7c53-696b-4a41-92a7-129723e0a42f 2021-07-13T01:07:38.759Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=556339b7-d7ba-422e-ad5d-b05babd38ee0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:38.874Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e86ff56a-f40a-443b-8976-c720ec0ce01c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:38.874Z InvocationID=1bb5029e-40a0-4ea3-91f0-e0425cb2109a 2021-07-13T01:07:38.967Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e86ff56a-f40a-443b-8976-c720ec0ce01c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:38.968Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=556339b7-d7ba-422e-ad5d-b05babd38ee0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=300 EndTimestamp=2021-07-13T01:07:38.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:38.667Z InvocationID=49680ea7-cd76-49ae-b55f-f8f8f83217d0 ResponseDesc=OK 2021-07-13T01:07:39.160Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e86ff56a-f40a-443b-8976-c720ec0ce01c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=286 EndTimestamp=2021-07-13T01:07:39.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:38.874Z InvocationID=35eee24a-6d1e-4f40-97a4-3172d21f030d ResponseDesc=OK 2021-07-13T01:07:41.776Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b28cc98b-b961-4a3f-8b27-ea2a01edb72d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:41.776Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:41.776Z InvocationID=bfdceec4-4b7e-4c7b-a839-11d9180ea35a 2021-07-13T01:07:41.957Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b28cc98b-b961-4a3f-8b27-ea2a01edb72d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:42.358Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b28cc98b-b961-4a3f-8b27-ea2a01edb72d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=581 EndTimestamp=2021-07-13T01:07:42.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:41.776Z InvocationID=04e7c21b-03ad-43f2-bf2b-7e5dedb26bf1 ResponseDesc=OK 2021-07-13T01:07:45.063Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4fcd1449-2c85-4648-a807-a949be2e7105 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:45.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:45.063Z InvocationID=2f71074d-7992-491a-82f4-2c8f295cb9e0 2021-07-13T01:07:45.459Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4fcd1449-2c85-4648-a807-a949be2e7105 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:46.112Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4fcd1449-2c85-4648-a807-a949be2e7105 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1049 EndTimestamp=2021-07-13T01:07:46.112Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:45.063Z InvocationID=5dab9b9c-abdf-457d-8caf-a283ede1c6f1 ResponseDesc=OK 2021-07-13T01:07:47.446Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=31b2817d-cdde-4755-b8de-4751a496575a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:47.446Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:47.446Z InvocationID=794f5df0-bb7d-4dcc-ba0c-6b8da9eb399f 2021-07-13T01:07:47.624Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=31b2817d-cdde-4755-b8de-4751a496575a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:47.961Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=31b2817d-cdde-4755-b8de-4751a496575a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=515 EndTimestamp=2021-07-13T01:07:47.961Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:47.446Z InvocationID=4cd6a873-85fa-4764-84d5-5bdc1f5291ea ResponseDesc=OK 2021-07-13T01:07:47.966Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=80e7ee23-6090-43d1-aee3-a80e120c42c2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:47.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:47.966Z InvocationID=fb8b3438-ef57-4e71-b9a5-b51ee5ab32bb 2021-07-13T01:07:48.156Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=80e7ee23-6090-43d1-aee3-a80e120c42c2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:48.457Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=80e7ee23-6090-43d1-aee3-a80e120c42c2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=491 EndTimestamp=2021-07-13T01:07:48.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:47.966Z InvocationID=2d96f57a-c18d-49dd-8e64-c1a0f8f86da0 ResponseDesc=OK 2021-07-13T01:07:48.874Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f16a4a7a-9365-48a1-beba-bc5b3aa7a8dd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:48.874Z InvocationID=d1a52680-dfa5-4fd4-8c22-b28c45fad31a 2021-07-13T01:07:48.960Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f16a4a7a-9365-48a1-beba-bc5b3aa7a8dd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:49.513Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f16a4a7a-9365-48a1-beba-bc5b3aa7a8dd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=638 EndTimestamp=2021-07-13T01:07:49.512Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:48.874Z InvocationID=8f531f31-da07-433f-a526-bc0a89a2ea5c ResponseDesc=OK 2021-07-13T01:07:50.971Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6bb41ebc-fac8-4809-99bf-aee38a63bc46 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:50.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:50.971Z InvocationID=4d2d95b5-80ac-41c0-9f7a-f338dbe41a05 2021-07-13T01:07:51.573Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6bb41ebc-fac8-4809-99bf-aee38a63bc46 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:51.761Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6bb41ebc-fac8-4809-99bf-aee38a63bc46 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=790 EndTimestamp=2021-07-13T01:07:51.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:50.971Z InvocationID=753dd503-3cf2-48e0-8d13-4e4da147e380 ResponseDesc=OK 2021-07-13T01:07:53.577Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7159efc0-0575-4eaa-b0b8-5a2032fb9e63 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:53.576Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:53.576Z InvocationID=cd1836a9-ffe1-4097-a3bf-79e1ea2248ab 2021-07-13T01:07:53.757Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7159efc0-0575-4eaa-b0b8-5a2032fb9e63 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:54.259Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7159efc0-0575-4eaa-b0b8-5a2032fb9e63 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=683 EndTimestamp=2021-07-13T01:07:54.259Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:53.576Z InvocationID=21faa64f-d605-4276-89da-693be1a0bac6 ResponseDesc=OK 2021-07-13T01:07:56.873Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d4d19f34-2f37-49c3-a14e-ac53d451ec76 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:56.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:56.873Z InvocationID=5ade684a-bed7-484c-ba4a-c4f6474827ff 2021-07-13T01:07:56.959Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d4d19f34-2f37-49c3-a14e-ac53d451ec76 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:57.220Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d4d19f34-2f37-49c3-a14e-ac53d451ec76 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=347 EndTimestamp=2021-07-13T01:07:57.220Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:56.873Z InvocationID=a760cd59-c531-4e1a-b158-fe0b0c9f3c35 ResponseDesc=OK 2021-07-13T01:07:57.439Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2e15efd4-7eed-42d1-b50b-f3be294cd5d5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:57.439Z InvocationID=b54332f6-f582-4c65-a337-cc8516fc5ae9 2021-07-13T01:07:57.615Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2e15efd4-7eed-42d1-b50b-f3be294cd5d5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:57.959Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2e15efd4-7eed-42d1-b50b-f3be294cd5d5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=520 EndTimestamp=2021-07-13T01:07:57.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:57.439Z InvocationID=475f3cd4-a6e2-494d-98e1-523b4c2bcfcc ResponseDesc=OK 2021-07-13T01:07:58.873Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e3b021dd-9bee-4934-b82b-e0cd352107c9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:58.873Z InvocationID=1aa9c79a-6227-460a-8cc3-143d135aca6c 2021-07-13T01:07:59.068Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e3b021dd-9bee-4934-b82b-e0cd352107c9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:07:59.757Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e3b021dd-9bee-4934-b82b-e0cd352107c9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=884 EndTimestamp=2021-07-13T01:07:59.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:58.873Z InvocationID=84c2c6df-2d98-4a5c-b8eb-4c2bb4d12935 ResponseDesc=OK 2021-07-13T01:07:59.765Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fe26efe9-5dfc-4d65-9a7e-78912010f616 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:07:59.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:59.765Z InvocationID=5044a29a-5a7b-48cc-80a3-52fa2bb841f4 2021-07-13T01:07:59.859Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fe26efe9-5dfc-4d65-9a7e-78912010f616 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:00.112Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fe26efe9-5dfc-4d65-9a7e-78912010f616 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=347 EndTimestamp=2021-07-13T01:08:00.112Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:07:59.765Z InvocationID=ccaf8f97-5e10-46f9-8eaa-84cc4e388eee ResponseDesc=OK 2021-07-13T01:08:02.676Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bb87cf08-3c28-4f5e-a59b-1c756d86273f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:02.676Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:02.676Z InvocationID=bb5833e3-713f-4e48-9b5c-e16d0f96e795 2021-07-13T01:08:02.914Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bb87cf08-3c28-4f5e-a59b-1c756d86273f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:04.659Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bb87cf08-3c28-4f5e-a59b-1c756d86273f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1983 EndTimestamp=2021-07-13T01:08:04.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:02.676Z InvocationID=000e33cf-01eb-4b96-960f-866fa0d48636 ResponseDesc=OK 2021-07-13T01:08:05.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c87b6d37-92b7-494b-84e6-73f0a7547a35 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:05.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:05.873Z InvocationID=01fc35df-9ffa-455f-8361-96d235106cce 2021-07-13T01:08:06.157Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c87b6d37-92b7-494b-84e6-73f0a7547a35 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:06.365Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c87b6d37-92b7-494b-84e6-73f0a7547a35 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=492 EndTimestamp=2021-07-13T01:08:06.365Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:05.873Z InvocationID=168dfa9b-f2b8-4498-beac-5130a01a459a ResponseDesc=OK 2021-07-13T01:08:07.440Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4a36be17-943a-4c18-af29-91632d4e511c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:07.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:07.440Z InvocationID=7be3d170-e6a3-4181-92df-db1897018297 2021-07-13T01:08:08.759Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4a36be17-943a-4c18-af29-91632d4e511c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:08.870Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=41d8b9d4-de76-46e4-87ef-c87a0b2c6f88 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:08.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:08.870Z InvocationID=c7a1c8da-034e-4c16-83ed-6c84026ac7c1 2021-07-13T01:08:08.873Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dc41f298-e3bc-4f20-89c6-5e46d752b7eb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:08.873Z InvocationID=c593e302-49b8-40dd-ac3a-e6cd07938281 2021-07-13T01:08:09.660Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dc41f298-e3bc-4f20-89c6-5e46d752b7eb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:09.713Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=41d8b9d4-de76-46e4-87ef-c87a0b2c6f88 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:09.714Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4a36be17-943a-4c18-af29-91632d4e511c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2274 EndTimestamp=2021-07-13T01:08:09.714Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:07.440Z InvocationID=5c8c4218-12ea-4bec-9285-0163bc256a1f ResponseDesc=OK 2021-07-13T01:08:10.360Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dc41f298-e3bc-4f20-89c6-5e46d752b7eb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1487 EndTimestamp=2021-07-13T01:08:10.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:08.873Z InvocationID=d8958df3-489e-42f8-bb20-b03dc3106fbe ResponseDesc=OK 2021-07-13T01:08:10.757Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=41d8b9d4-de76-46e4-87ef-c87a0b2c6f88 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1887 EndTimestamp=2021-07-13T01:08:10.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:08.870Z InvocationID=2e226fab-2e4c-4504-99c7-c593da9e5e5f ResponseDesc=OK 2021-07-13T01:08:11.974Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5fc1d0d9-2562-4295-91ce-fe9d8edda8b2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:11.974Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:11.974Z InvocationID=fa740456-97cc-4ed7-854f-4161af9c3a88 2021-07-13T01:08:12.162Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5fc1d0d9-2562-4295-91ce-fe9d8edda8b2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:12.520Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5fc1d0d9-2562-4295-91ce-fe9d8edda8b2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=546 EndTimestamp=2021-07-13T01:08:12.520Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:11.974Z InvocationID=2590985b-ee2f-43d2-b133-975873c7ee18 ResponseDesc=OK 2021-07-13T01:08:15.064Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=961e1185-6fc1-4b8d-978e-3d21eb0b536a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:15.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:15.064Z InvocationID=37aaf48c-1d33-4be6-8900-8c30ff6be774 2021-07-13T01:08:15.274Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=961e1185-6fc1-4b8d-978e-3d21eb0b536a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:15.465Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=961e1185-6fc1-4b8d-978e-3d21eb0b536a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=401 EndTimestamp=2021-07-13T01:08:15.465Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:15.064Z InvocationID=b0439dfd-0fab-4865-ba05-42c2a1f5c808 ResponseDesc=OK 2021-07-13T01:08:17.448Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9b98fb7-5770-4703-a40f-e1a269ee42ee InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:17.448Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:17.448Z InvocationID=db4c4f5c-9bd2-4fc7-a610-f670859d3e14 2021-07-13T01:08:17.560Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b9b98fb7-5770-4703-a40f-e1a269ee42ee InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:18.063Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=45d85900-34ef-4ec6-a004-bfe7b7911a46 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:18.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:18.062Z InvocationID=7755ba4d-0bbd-457e-9370-038ce9f557c3 2021-07-13T01:08:18.160Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=45d85900-34ef-4ec6-a004-bfe7b7911a46 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:18.358Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b9b98fb7-5770-4703-a40f-e1a269ee42ee InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=909 EndTimestamp=2021-07-13T01:08:18.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:17.448Z InvocationID=49983894-5a80-4d35-8789-c14c8f726ba4 ResponseDesc=OK 2021-07-13T01:08:18.672Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=45d85900-34ef-4ec6-a004-bfe7b7911a46 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=610 EndTimestamp=2021-07-13T01:08:18.672Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:18.062Z InvocationID=64790311-3d22-4ee9-bd9c-91fff84f929d ResponseDesc=OK 2021-07-13T01:08:18.875Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8a8bc0a7-58e3-4607-b94b-537ca9bbf34f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:18.874Z InvocationID=687acd31-1389-4303-96aa-9276209436b1 2021-07-13T01:08:19.112Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8a8bc0a7-58e3-4607-b94b-537ca9bbf34f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:19.364Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8a8bc0a7-58e3-4607-b94b-537ca9bbf34f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=489 EndTimestamp=2021-07-13T01:08:19.363Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:18.874Z InvocationID=a5065485-d82e-4a01-a0ba-4721d24d9a66 ResponseDesc=OK 2021-07-13T01:08:20.963Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6250f2a5-faca-4770-acfb-dc379dc57d00 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:20.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:20.962Z InvocationID=e8a9c78e-2f86-4ecf-8e76-91db46bb698d 2021-07-13T01:08:21.156Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6250f2a5-faca-4770-acfb-dc379dc57d00 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:21.958Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6250f2a5-faca-4770-acfb-dc379dc57d00 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=996 EndTimestamp=2021-07-13T01:08:21.958Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:20.962Z InvocationID=74511065-b71b-4698-8a26-5d2a1a79b359 ResponseDesc=OK 2021-07-13T01:08:24.163Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=732fdb98-c9e1-48f8-8ce2-8f83cc05d3ca InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:24.163Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:24.163Z InvocationID=a53a5ffd-1570-47d4-9ba4-d1a23c029f53 2021-07-13T01:08:24.261Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=732fdb98-c9e1-48f8-8ce2-8f83cc05d3ca InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:24.816Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=732fdb98-c9e1-48f8-8ce2-8f83cc05d3ca InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=653 EndTimestamp=2021-07-13T01:08:24.816Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:24.163Z InvocationID=82acd315-2d8a-4e41-b505-a3e7fa34e6a2 ResponseDesc=OK 2021-07-13T01:08:27.161Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dcb0983a-820a-4988-b9a8-6ca9f7af0620 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:27.161Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:27.161Z InvocationID=7580bfbd-d97f-4dc4-92a0-2dec97d242a0 2021-07-13T01:08:27.413Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dcb0983a-820a-4988-b9a8-6ca9f7af0620 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:27.440Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cfe4b2be-7326-409e-bc7c-842629f7f4eb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:27.440Z InvocationID=04ec4a70-d426-4834-8757-2cf3b37626db 2021-07-13T01:08:27.656Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cfe4b2be-7326-409e-bc7c-842629f7f4eb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:27.660Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dcb0983a-820a-4988-b9a8-6ca9f7af0620 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=499 EndTimestamp=2021-07-13T01:08:27.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:27.161Z InvocationID=54ca376f-1521-488e-b09f-007e4a8b77e3 ResponseDesc=OK 2021-07-13T01:08:27.957Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cfe4b2be-7326-409e-bc7c-842629f7f4eb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=517 EndTimestamp=2021-07-13T01:08:27.957Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:27.440Z InvocationID=6a8190b6-ad4f-40c7-8c20-c8d0e2e0f3e8 ResponseDesc=OK 2021-07-13T01:08:28.875Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4ebd55f7-68ea-4de0-b32e-de1455d1beb8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:28.874Z InvocationID=6a58bd8c-04a4-454a-80fa-cee1e8ef4f9d 2021-07-13T01:08:32.359Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4ebd55f7-68ea-4de0-b32e-de1455d1beb8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:33.238Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cea1bc91-a8ad-45a4-8477-c753e61ec89d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:33.237Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:33.237Z InvocationID=359070fd-2db3-4ee6-a59a-f408612d5c8b 2021-07-13T01:08:33.375Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4ebd55f7-68ea-4de0-b32e-de1455d1beb8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=4501 EndTimestamp=2021-07-13T01:08:33.375Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:28.874Z InvocationID=50f6d56d-1f6b-4e36-8f19-9fedf432d68a ResponseDesc=OK 2021-07-13T01:08:33.567Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cea1bc91-a8ad-45a4-8477-c753e61ec89d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:33.664Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cea1bc91-a8ad-45a4-8477-c753e61ec89d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=427 EndTimestamp=2021-07-13T01:08:33.664Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:33.237Z InvocationID=44cd19dc-b4ad-43af-83b8-5356a0bd1bc5 ResponseDesc=OK 2021-07-13T01:08:34.861Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bbb2f660-46b0-454a-96af-5bc3a8e87867 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:34.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:34.861Z InvocationID=31efc120-f427-444f-b6ac-159e1156c230 2021-07-13T01:08:34.957Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bbb2f660-46b0-454a-96af-5bc3a8e87867 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:35.273Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bbb2f660-46b0-454a-96af-5bc3a8e87867 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=412 EndTimestamp=2021-07-13T01:08:35.273Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:34.861Z InvocationID=412b95d2-4f35-4d5f-8713-1b576f7d1100 ResponseDesc=OK 2021-07-13T01:08:36.164Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8a9939ef-7f35-4f31-a1f5-f44fdf6cd46c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:36.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:36.164Z InvocationID=e7b573dc-d1c6-4d5e-be0c-aaeced45950f 2021-07-13T01:08:36.259Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8a9939ef-7f35-4f31-a1f5-f44fdf6cd46c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:36.485Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8a9939ef-7f35-4f31-a1f5-f44fdf6cd46c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=321 EndTimestamp=2021-07-13T01:08:36.485Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:36.164Z InvocationID=6224feed-3d52-4ddb-a8f6-dc3291cdb34a ResponseDesc=OK 2021-07-13T01:08:37.439Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d75dc39-49f6-419e-9e09-1e2a8586d645 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:37.439Z InvocationID=d95c5c54-bc43-4cc7-a0fd-0b8a752cf90e 2021-07-13T01:08:37.816Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d75dc39-49f6-419e-9e09-1e2a8586d645 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:38.060Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d75dc39-49f6-419e-9e09-1e2a8586d645 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=621 EndTimestamp=2021-07-13T01:08:38.060Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:37.439Z InvocationID=eefef54d-7cde-4ec0-b318-5b300629f5cf ResponseDesc=OK 2021-07-13T01:08:38.874Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6683640c-ae27-4ce6-bdae-c3a6364271fc InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:38.874Z InvocationID=370302af-78a7-486f-a2ee-e4792d08126a 2021-07-13T01:08:39.062Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6683640c-ae27-4ce6-bdae-c3a6364271fc InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:39.260Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=68166dac-2b64-4064-8d6b-10776954991e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:39.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:39.260Z InvocationID=74fbfedd-baaa-49c6-b22e-9d88401c2f8b 2021-07-13T01:08:39.359Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=68166dac-2b64-4064-8d6b-10776954991e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:39.858Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6683640c-ae27-4ce6-bdae-c3a6364271fc InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=983 EndTimestamp=2021-07-13T01:08:39.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:38.874Z InvocationID=d58b5d5b-e444-47e7-b08e-191aac493ac0 ResponseDesc=OK 2021-07-13T01:08:40.127Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=68166dac-2b64-4064-8d6b-10776954991e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=867 EndTimestamp=2021-07-13T01:08:40.127Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:39.260Z InvocationID=660243cf-2285-4584-8f4a-92c2f17fd4c6 ResponseDesc=OK 2021-07-13T01:08:41.873Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8b3d0569-36d9-4311-9eeb-0d471622c18b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:41.873Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:41.873Z InvocationID=aa93f3da-10a7-4895-acad-9ea1d3c99c76 2021-07-13T01:08:42.128Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8b3d0569-36d9-4311-9eeb-0d471622c18b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:42.670Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8b3d0569-36d9-4311-9eeb-0d471622c18b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=796 EndTimestamp=2021-07-13T01:08:42.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:41.873Z InvocationID=c8007f9f-a97a-456c-ac67-653fff292110 ResponseDesc=OK 2021-07-13T01:08:44.765Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e0aefcfe-b44a-4f62-883f-18aec386f71d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:44.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:44.765Z InvocationID=bcc49694-43d1-42f7-b6ed-1bb05bfa3f4b 2021-07-13T01:08:44.856Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e0aefcfe-b44a-4f62-883f-18aec386f71d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:45.268Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e0aefcfe-b44a-4f62-883f-18aec386f71d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=503 EndTimestamp=2021-07-13T01:08:45.268Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:44.765Z InvocationID=66fbc951-8e63-47cc-bb8f-e9edcdc634a5 ResponseDesc=OK 2021-07-13T01:08:47.441Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6ee1f1a8-ba75-49a4-b458-51678bd4a3e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:47.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:47.441Z InvocationID=69e490ab-34a9-408f-a054-d8a53e31217c 2021-07-13T01:08:47.558Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6ee1f1a8-ba75-49a4-b458-51678bd4a3e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:47.672Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9ee6c310-ebc0-4c4f-8f76-ca123aa519d8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:47.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:47.671Z InvocationID=39ab96d4-9178-471b-931e-781e5a0110dd 2021-07-13T01:08:48.874Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=38d93d13-f0f6-4805-8b2d-75c275d8888b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:48.874Z InvocationID=b0050536-e4ef-4de5-8182-a11a58ee2790 2021-07-13T01:08:53.759Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=38d93d13-f0f6-4805-8b2d-75c275d8888b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:53.919Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9ee6c310-ebc0-4c4f-8f76-ca123aa519d8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:53.960Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=38d93d13-f0f6-4805-8b2d-75c275d8888b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=5086 EndTimestamp=2021-07-13T01:08:53.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:48.874Z InvocationID=046afb3c-8866-4efd-8fe7-3ca7d9168b31 ResponseDesc=OK 2021-07-13T01:08:54.258Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9ee6c310-ebc0-4c4f-8f76-ca123aa519d8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=6587 EndTimestamp=2021-07-13T01:08:54.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:47.671Z InvocationID=605dd54b-f84a-4ad4-9c2c-ca5f67def489 ResponseDesc=OK 2021-07-13T01:08:54.574Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b976bb4d-d2e5-415d-9268-fd62e698b82b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:54.574Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:54.574Z InvocationID=7dad8b1f-543e-4469-ba71-57f3f03a8cee 2021-07-13T01:08:54.663Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b976bb4d-d2e5-415d-9268-fd62e698b82b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:54.772Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b976bb4d-d2e5-415d-9268-fd62e698b82b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=198 EndTimestamp=2021-07-13T01:08:54.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:54.574Z InvocationID=4dc023b7-11de-421d-ae72-605d607efa1b ResponseDesc=OK 2021-07-13T01:08:55.573Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aa156eb5-73a9-4dde-a56a-2920f8efe779 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:55.573Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:55.573Z InvocationID=a92668f7-e937-47a1-a8ed-29efb21722f9 2021-07-13T01:08:55.729Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aa156eb5-73a9-4dde-a56a-2920f8efe779 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:55.960Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aa156eb5-73a9-4dde-a56a-2920f8efe779 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=387 EndTimestamp=2021-07-13T01:08:55.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:55.573Z InvocationID=0c3a9c86-174c-4dff-a590-1dc7f15004e1 ResponseDesc=OK 2021-07-13T01:08:56.920Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=daa2671b-417a-4d8c-8b51-c24326ac0457 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:56.920Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:56.920Z InvocationID=6777dce0-8d31-4f10-bf21-fbab85047b57 2021-07-13T01:08:57.057Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=daa2671b-417a-4d8c-8b51-c24326ac0457 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:57.732Z [qtp817348612-16] ERROR o.o.s.health.impl.HealthCheckDaoImpl RequestID=6ee1f1a8-ba75-49a4-b458-51678bd4a3e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health check failureCassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:08:57.732Z [qtp817348612-16] ERROR o.o.s.h.impl.HealthCheckManagerImpl RequestID=6ee1f1a8-ba75-49a4-b458-51678bd4a3e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at org.openecomp.sdc.health.impl.$Proxy39.checkHealth(Unknown Source) at org.openecomp.sdc.health.impl.HealthCheckDaoImpl.checkHealth(HealthCheckDaoImpl.java:41) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:70) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:08:57.733Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=6ee1f1a8-ba75-49a4-b458-51678bd4a3e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=10292 EndTimestamp=2021-07-13T01:08:57.733Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:47.441Z InvocationID=30bca538-80a2-41ec-a780-2d79fcdec078 ResponseDesc=Internal Server Error 2021-07-13T01:08:57.737Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e2008f85-1092-4a24-8183-d1a80076c5e2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:57.737Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:57.737Z InvocationID=dc7ccf15-4db3-454d-9147-90c1ed490034 2021-07-13T01:08:57.867Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e2008f85-1092-4a24-8183-d1a80076c5e2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:08:57.957Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=daa2671b-417a-4d8c-8b51-c24326ac0457 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1037 EndTimestamp=2021-07-13T01:08:57.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:56.920Z InvocationID=fb6ce7eb-8033-4c3e-ab3e-e3ab0670c851 ResponseDesc=OK 2021-07-13T01:08:58.169Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e2008f85-1092-4a24-8183-d1a80076c5e2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=431 EndTimestamp=2021-07-13T01:08:58.168Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:57.737Z InvocationID=13d5e34b-668c-440a-bc10-2e97562c17e8 ResponseDesc=OK 2021-07-13T01:08:58.875Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fef9c305-3d18-453b-a496-749c15122f2e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:08:58.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:58.875Z InvocationID=5a4673f2-4ee9-470c-8643-076e9f0a0aa4 2021-07-13T01:08:59.912Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fef9c305-3d18-453b-a496-749c15122f2e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:00.267Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fef9c305-3d18-453b-a496-749c15122f2e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1392 EndTimestamp=2021-07-13T01:09:00.267Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:08:58.875Z InvocationID=8d9f33dd-fb63-402e-9ac1-6ff17b600395 ResponseDesc=OK 2021-07-13T01:09:00.424Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4c2b4d3f-4a1c-4d61-a16f-0bde58650be4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:00.423Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:00.423Z InvocationID=7c385b59-b7d6-45e1-8a19-d079a524477f 2021-07-13T01:09:00.657Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4c2b4d3f-4a1c-4d61-a16f-0bde58650be4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:00.957Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4c2b4d3f-4a1c-4d61-a16f-0bde58650be4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=534 EndTimestamp=2021-07-13T01:09:00.957Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:00.423Z InvocationID=c6929df1-ddea-4321-b7fe-34707db496fb ResponseDesc=OK 2021-07-13T01:09:03.064Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2b14b3fa-55fb-4d35-b780-e95a4d4ca1bd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:03.063Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:03.063Z InvocationID=1d67350d-a5d4-4d4c-a1eb-77758ce3cecc 2021-07-13T01:09:03.259Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2b14b3fa-55fb-4d35-b780-e95a4d4ca1bd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:03.617Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2b14b3fa-55fb-4d35-b780-e95a4d4ca1bd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=554 EndTimestamp=2021-07-13T01:09:03.617Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:03.063Z InvocationID=10349ea8-557a-406a-852f-fba327e76ec4 ResponseDesc=OK 2021-07-13T01:09:05.869Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fd4414b4-bbbb-447c-9e65-5fb1b6e7d0a7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:05.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:05.869Z InvocationID=11509107-f82b-4d91-91e8-4be6a0aedbac 2021-07-13T01:09:07.441Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7441cfba-c031-4493-a9cc-c024a9ede695 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:07.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:07.441Z InvocationID=db2b5d6d-285f-4d97-8946-96a6cca3be93 2021-07-13T01:09:08.758Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7441cfba-c031-4493-a9cc-c024a9ede695 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:08.874Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1cf2e304-df8b-4ed6-8ae3-02f5accfc135 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:08.874Z InvocationID=62fddacd-abc7-43b7-b845-eb6c4dbd4305 2021-07-13T01:09:08.918Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fd4414b4-bbbb-447c-9e65-5fb1b6e7d0a7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:08.961Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7441cfba-c031-4493-a9cc-c024a9ede695 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1520 EndTimestamp=2021-07-13T01:09:08.961Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:07.441Z InvocationID=af0aed6b-44dd-4f09-a260-039670119e43 ResponseDesc=OK 2021-07-13T01:09:09.157Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fd4414b4-bbbb-447c-9e65-5fb1b6e7d0a7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=3288 EndTimestamp=2021-07-13T01:09:09.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:05.869Z InvocationID=1a5969e6-9581-48ff-952e-c7221aa933b8 ResponseDesc=OK 2021-07-13T01:09:09.219Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1cf2e304-df8b-4ed6-8ae3-02f5accfc135 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:09.714Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1cf2e304-df8b-4ed6-8ae3-02f5accfc135 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=839 EndTimestamp=2021-07-13T01:09:09.713Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:08.874Z InvocationID=17cf88cc-b196-4405-8ae6-4f161e380e9a ResponseDesc=OK 2021-07-13T01:09:10.211Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d2f66d9-0daf-4361-8041-184138f48e7b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:10.211Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:10.211Z InvocationID=e2d7c3d9-5203-41e3-8bc9-fed92900be5d 2021-07-13T01:09:16.762Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5d41a301-3f49-42d9-8eae-82f78a52569b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:16.762Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:16.762Z InvocationID=2bce370f-62eb-4c07-8992-ff2799591782 2021-07-13T01:09:16.861Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5d41a301-3f49-42d9-8eae-82f78a52569b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:17.062Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5d41a301-3f49-42d9-8eae-82f78a52569b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=300 EndTimestamp=2021-07-13T01:09:17.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:16.762Z InvocationID=2a9061be-fd6a-4aed-9e4d-4d3075c79769 ResponseDesc=OK 2021-07-13T01:09:17.445Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f9909401-cc35-48b8-a841-2b9e747220de InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:17.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:17.444Z InvocationID=0588adad-c359-464e-8047-03d36216d767 2021-07-13T01:09:17.713Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f9909401-cc35-48b8-a841-2b9e747220de InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:18.261Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f9909401-cc35-48b8-a841-2b9e747220de InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=817 EndTimestamp=2021-07-13T01:09:18.261Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:17.444Z InvocationID=af164ba0-a6cf-4f3c-85fb-c32d986937d5 ResponseDesc=OK 2021-07-13T01:09:18.461Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=36189e37-165f-41ee-8eab-a9721374a2d0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:18.461Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:18.461Z InvocationID=9e970566-315e-4eb1-b138-20064cf16e0c 2021-07-13T01:09:18.657Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=36189e37-165f-41ee-8eab-a9721374a2d0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:18.874Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3a824c72-261a-4da2-8a4e-177aab6b340f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:18.874Z InvocationID=2171e952-ab9e-422a-a98d-11570dc4b645 2021-07-13T01:09:19.059Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3a824c72-261a-4da2-8a4e-177aab6b340f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:19.260Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=36189e37-165f-41ee-8eab-a9721374a2d0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=799 EndTimestamp=2021-07-13T01:09:19.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:18.461Z InvocationID=b683cc63-e6a8-4d28-af26-7770cc75b736 ResponseDesc=OK 2021-07-13T01:09:19.327Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3a824c72-261a-4da2-8a4e-177aab6b340f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=453 EndTimestamp=2021-07-13T01:09:19.327Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:18.874Z InvocationID=2113f417-d62b-4d62-88b8-a0be67610070 ResponseDesc=OK 2021-07-13T01:09:20.166Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b93cea31-60f5-4a6a-a44b-7b8ee05ed729 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:20.166Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:20.166Z InvocationID=0a71c661-4acb-4959-bed1-7191fdfadb15 2021-07-13T01:09:20.218Z [qtp817348612-17] ERROR c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d2f66d9-0daf-4361-8041-184138f48e7b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:96) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:22) at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35) at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:293) at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:58) at com.datastax.driver.mapping.MethodMapper.invoke(MethodMapper.java:184) at com.datastax.driver.mapping.AccessorInvocationHandler.invoke(AccessorInvocationHandler.java:67) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.$Proxy135.check(Unknown Source) at com.amdocs.zusammen.plugin.statestore.cassandra.dao.impl.KeepAliveCassandraDao.get(KeepAliveCassandraDao.java:13) at com.amdocs.zusammen.plugin.statestore.cassandra.StateStoreImpl.checkHealth(StateStoreImpl.java:51) at com.amdocs.zusammen.adaptor.outbound.impl.health.HealthAdaptorImpl.getStateStatus(HealthAdaptorImpl.java:83) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:16) at com.amdocs.zusammen.core.impl.health.StateHealthService.checkHealth(StateHealthService.java:8) at com.amdocs.zusammen.commons.health.service.HealthCheckService.getHealthStatus(HealthCheckService.java:30) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:46) at com.amdocs.zusammen.core.impl.health.HealthManagerImpl.getHealthStatus(HealthManagerImpl.java:29) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:40) at com.amdocs.zusammen.adaptor.inbound.impl.health.HealthAdaptorImpl.getHealthStatus(HealthAdaptorImpl.java:32) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.checkHealth(ZusammenConnectorImpl.java:66) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.checkHealth(ZusammenAdaptorImpl.java:246) at org.openecomp.sdc.health.impl.HealthCheckManagerImpl.checkHealth(HealthCheckManagerImpl.java:62) at org.openecomp.sdcrests.health.rest.services.HealthCheckImpl.checkHealth(HealthCheckImpl.java:59) at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy49.checkHealth(Unknown Source) at jdk.internal.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:201) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:104) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:267) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:225) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:301) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:276) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdcrests.filters.SessionContextFilter.doFilter(SessionContextFilter.java:47) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.preProcessingRequest(SessionValidationFilter.java:154) at org.openecomp.sdc.securityutil.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:118) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_ONE (1 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-07-13T01:09:20.431Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b93cea31-60f5-4a6a-a44b-7b8ee05ed729 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:20.458Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=500 RequestID=2d2f66d9-0daf-4361-8041-184138f48e7b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=10247 EndTimestamp=2021-07-13T01:09:20.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=ERROR ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:10.211Z InvocationID=178ba619-5146-4d20-91d6-32770c368b10 ResponseDesc=Internal Server Error 2021-07-13T01:09:21.671Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b93cea31-60f5-4a6a-a44b-7b8ee05ed729 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1505 EndTimestamp=2021-07-13T01:09:21.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:20.166Z InvocationID=558fb16c-c41c-429e-984d-225715382bbf ResponseDesc=OK 2021-07-13T01:09:22.775Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f4364a39-4bf9-4d64-9ec3-c2d28fca9c00 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:22.775Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:22.775Z InvocationID=6f58df52-ebf3-49c8-a040-42becc792925 2021-07-13T01:09:23.016Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f4364a39-4bf9-4d64-9ec3-c2d28fca9c00 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:23.086Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f4364a39-4bf9-4d64-9ec3-c2d28fca9c00 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=311 EndTimestamp=2021-07-13T01:09:23.086Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:22.775Z InvocationID=1f4e793f-3728-4878-9e8e-b361feb4df27 ResponseDesc=OK 2021-07-13T01:09:23.968Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=50cfbbd7-d8b9-4c61-b354-f5f2b151fe33 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:23.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:23.968Z InvocationID=18519ab1-f767-4943-929f-624ccfbe5c1f 2021-07-13T01:09:24.157Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=50cfbbd7-d8b9-4c61-b354-f5f2b151fe33 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:24.657Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=50cfbbd7-d8b9-4c61-b354-f5f2b151fe33 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=689 EndTimestamp=2021-07-13T01:09:24.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:23.968Z InvocationID=39e20de2-97f1-462f-882f-1db41e8b7e44 ResponseDesc=OK 2021-07-13T01:09:26.878Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4a4bb3d2-e058-4af0-9f26-5365c675f9ca InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:26.878Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:26.878Z InvocationID=e46bc045-1e8d-4269-9a89-27c9467ab645 2021-07-13T01:09:26.960Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4a4bb3d2-e058-4af0-9f26-5365c675f9ca InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:27.427Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4a4bb3d2-e058-4af0-9f26-5365c675f9ca InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=549 EndTimestamp=2021-07-13T01:09:27.427Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:26.878Z InvocationID=829bd011-56ee-4529-a26f-e34d484c2b2c ResponseDesc=OK 2021-07-13T01:09:27.439Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c69f7df4-748e-43d2-9a49-887a4202c741 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:27.439Z InvocationID=995f832b-f9bf-4fd9-b14e-e57a29e4d5c4 2021-07-13T01:09:28.611Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c69f7df4-748e-43d2-9a49-887a4202c741 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:28.860Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c69f7df4-748e-43d2-9a49-887a4202c741 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1421 EndTimestamp=2021-07-13T01:09:28.860Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:27.439Z InvocationID=6ff8e7c1-0dc6-4531-bf55-6742069c4b77 ResponseDesc=OK 2021-07-13T01:09:28.874Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f21d09e-ebd9-4177-ae9a-42bfbec112c3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:28.874Z InvocationID=4fc946de-79e6-49e4-b731-74440f3c24de 2021-07-13T01:09:29.256Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f21d09e-ebd9-4177-ae9a-42bfbec112c3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:30.258Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0f21d09e-ebd9-4177-ae9a-42bfbec112c3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1384 EndTimestamp=2021-07-13T01:09:30.258Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:28.874Z InvocationID=c746d303-1999-4aec-99b5-842e77390121 ResponseDesc=OK 2021-07-13T01:09:30.567Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9b34c74-0d88-47e3-9abc-2dd76c814b55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:30.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:30.567Z InvocationID=21c0e86a-cd23-4bfc-ab54-5f9c632f6677 2021-07-13T01:09:30.759Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b9b34c74-0d88-47e3-9abc-2dd76c814b55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:31.760Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b9b34c74-0d88-47e3-9abc-2dd76c814b55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1193 EndTimestamp=2021-07-13T01:09:31.760Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:30.567Z InvocationID=f24519c5-8fb1-4d26-82d8-c274dfae3e9b ResponseDesc=OK 2021-07-13T01:09:32.978Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2d7836db-29f4-4734-9a47-c22be7f21303 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:32.977Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:32.977Z InvocationID=8523cac7-2f3a-488e-a0f0-cd223a0e74c2 2021-07-13T01:09:33.218Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2d7836db-29f4-4734-9a47-c22be7f21303 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:33.463Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2d7836db-29f4-4734-9a47-c22be7f21303 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=486 EndTimestamp=2021-07-13T01:09:33.463Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:32.977Z InvocationID=447899b0-dcd8-499a-bc53-bd2abe93735b ResponseDesc=OK 2021-07-13T01:09:35.767Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c7a7d0d1-bbb5-424f-bc51-b89fe776396d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:35.767Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:35.767Z InvocationID=102cde84-b81b-4018-82df-0115e4774e51 2021-07-13T01:09:35.860Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c7a7d0d1-bbb5-424f-bc51-b89fe776396d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:36.258Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c7a7d0d1-bbb5-424f-bc51-b89fe776396d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=491 EndTimestamp=2021-07-13T01:09:36.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:35.767Z InvocationID=f36b02e7-d8a2-4e0d-8e9b-2c22c6194d64 ResponseDesc=OK 2021-07-13T01:09:37.442Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5e209a77-ad74-4821-b05e-5c97eff89202 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:37.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:37.442Z InvocationID=008f72c4-3cf4-4468-8400-3c33329faf4a 2021-07-13T01:09:37.559Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5e209a77-ad74-4821-b05e-5c97eff89202 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:37.817Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5e209a77-ad74-4821-b05e-5c97eff89202 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=375 EndTimestamp=2021-07-13T01:09:37.817Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:37.442Z InvocationID=cd98642e-ae02-4187-92a4-130ab21da3cc ResponseDesc=OK 2021-07-13T01:09:38.864Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ab31ed13-60cd-457e-b6e7-0ef9c279dbd5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:38.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:38.863Z InvocationID=f931a6ac-f944-4ee4-be01-ce3208e2198a 2021-07-13T01:09:38.874Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b3799f1f-7a7f-41ad-99fb-e1f1d978c93d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:38.874Z InvocationID=78dc74db-0a1c-4b2e-a1da-2e0867c3df35 2021-07-13T01:09:38.971Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ab31ed13-60cd-457e-b6e7-0ef9c279dbd5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:39.059Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b3799f1f-7a7f-41ad-99fb-e1f1d978c93d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:39.462Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ab31ed13-60cd-457e-b6e7-0ef9c279dbd5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=599 EndTimestamp=2021-07-13T01:09:39.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:38.863Z InvocationID=b1ade55a-5f25-4694-8231-772a47c10ed5 ResponseDesc=OK 2021-07-13T01:09:44.959Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b3799f1f-7a7f-41ad-99fb-e1f1d978c93d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=6085 EndTimestamp=2021-07-13T01:09:44.959Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:38.874Z InvocationID=10103ec4-41e3-4810-9049-6d74ffe78891 ResponseDesc=OK 2021-07-13T01:09:45.326Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=29903c53-7cdd-48ec-9fec-92a6b2b94b77 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:45.326Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:45.326Z InvocationID=d14c7810-15c6-4064-832f-6c74320ddda2 2021-07-13T01:09:47.441Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0fee4daa-4240-43a2-a203-de61d4d1d709 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:47.440Z InvocationID=5f5a00d4-d45f-412e-90d1-b0ce677bc847 2021-07-13T01:09:48.874Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=48acb311-2c4e-46c9-a42b-1c3736cfbdfe InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:48.874Z InvocationID=07d32d6e-ede9-4322-b2ec-add0bf30a4b3 2021-07-13T01:09:50.058Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0fee4daa-4240-43a2-a203-de61d4d1d709 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:50.058Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=29903c53-7cdd-48ec-9fec-92a6b2b94b77 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:50.213Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=48acb311-2c4e-46c9-a42b-1c3736cfbdfe InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:50.261Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=29903c53-7cdd-48ec-9fec-92a6b2b94b77 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=4935 EndTimestamp=2021-07-13T01:09:50.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:45.326Z InvocationID=9de6efad-6e06-465d-a0da-4d297f90ef19 ResponseDesc=OK 2021-07-13T01:09:50.312Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0fee4daa-4240-43a2-a203-de61d4d1d709 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2872 EndTimestamp=2021-07-13T01:09:50.312Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:47.440Z InvocationID=10f47974-fd13-434e-9e60-3b4d538eb79e ResponseDesc=OK 2021-07-13T01:09:50.557Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=48acb311-2c4e-46c9-a42b-1c3736cfbdfe InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1683 EndTimestamp=2021-07-13T01:09:50.557Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:48.874Z InvocationID=5422face-c4e1-414f-a8ef-2d837e65ff1c ResponseDesc=OK 2021-07-13T01:09:50.563Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=460cf2b6-05ca-42c2-97dd-09cbd6085382 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:50.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:50.562Z InvocationID=5b344010-5274-4c9d-9169-07cae9594112 2021-07-13T01:09:50.659Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=460cf2b6-05ca-42c2-97dd-09cbd6085382 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:50.917Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=460cf2b6-05ca-42c2-97dd-09cbd6085382 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=354 EndTimestamp=2021-07-13T01:09:50.916Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:50.562Z InvocationID=de8e01a6-cc69-43aa-9b75-dbae6e1269e3 ResponseDesc=OK 2021-07-13T01:09:51.968Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=55e14eae-7ecd-4149-a4ce-e8c6ae8c70a3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:51.967Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:51.967Z InvocationID=fcfc58bd-4118-4816-bc18-948b99cbe75d 2021-07-13T01:09:52.215Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=55e14eae-7ecd-4149-a4ce-e8c6ae8c70a3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:52.460Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=55e14eae-7ecd-4149-a4ce-e8c6ae8c70a3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=493 EndTimestamp=2021-07-13T01:09:52.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:51.967Z InvocationID=0ac1bf22-0141-4c64-b6f7-988f5d15249b ResponseDesc=OK 2021-07-13T01:09:53.476Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d06706bd-7eeb-428a-aab3-fc835c84a81d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:53.475Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:53.475Z InvocationID=f4f42b18-fb87-449a-be70-d4afd115ce51 2021-07-13T01:09:53.756Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d06706bd-7eeb-428a-aab3-fc835c84a81d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:54.258Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d06706bd-7eeb-428a-aab3-fc835c84a81d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=783 EndTimestamp=2021-07-13T01:09:54.258Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:53.475Z InvocationID=71326ee3-1b36-4242-a0b4-55a3724e884b ResponseDesc=OK 2021-07-13T01:09:55.165Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=93775ca2-e92a-485c-9ede-30234e55f340 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:55.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:55.165Z InvocationID=e6ba42e0-c671-4f74-b272-5b3e19b66255 2021-07-13T01:09:55.259Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=93775ca2-e92a-485c-9ede-30234e55f340 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:55.613Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=93775ca2-e92a-485c-9ede-30234e55f340 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=448 EndTimestamp=2021-07-13T01:09:55.613Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:55.165Z InvocationID=dc1974e3-d297-44c5-92d3-a0fa8f1a9dcb ResponseDesc=OK 2021-07-13T01:09:56.669Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be86eaeb-4a51-4346-b2d1-9b7da42b3323 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:56.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:56.669Z InvocationID=a7f6e3aa-1ad0-4722-ac1c-676aeb404112 2021-07-13T01:09:56.868Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be86eaeb-4a51-4346-b2d1-9b7da42b3323 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:57.059Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be86eaeb-4a51-4346-b2d1-9b7da42b3323 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=390 EndTimestamp=2021-07-13T01:09:57.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:56.669Z InvocationID=8e8dd98a-ed3f-468e-a44c-493aea01f80b ResponseDesc=OK 2021-07-13T01:09:57.442Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b477b7b8-9363-41a4-9924-ff14bf6cbb15 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:57.442Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:57.442Z InvocationID=703680cd-4dec-4d44-9f12-c564f520d10f 2021-07-13T01:09:57.557Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b477b7b8-9363-41a4-9924-ff14bf6cbb15 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:57.858Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b477b7b8-9363-41a4-9924-ff14bf6cbb15 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=416 EndTimestamp=2021-07-13T01:09:57.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:57.442Z InvocationID=3d045a1a-ac68-4879-b9d6-24cfb99426fc ResponseDesc=OK 2021-07-13T01:09:58.874Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e744a73b-e367-4efb-8839-b8ee6bb0876d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:58.874Z InvocationID=d1f432b2-42f6-4e2d-b254-7e2033513bc1 2021-07-13T01:09:58.960Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e744a73b-e367-4efb-8839-b8ee6bb0876d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:09:59.411Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e744a73b-e367-4efb-8839-b8ee6bb0876d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=537 EndTimestamp=2021-07-13T01:09:59.411Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:58.874Z InvocationID=30c3d9b7-bd0e-465a-bd40-d8fb5d417b9a ResponseDesc=OK 2021-07-13T01:09:59.773Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8a171326-87c5-4288-a94c-1fe302a5819f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:09:59.773Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:59.773Z InvocationID=9c619c68-6c6c-45a6-b79c-32b766fd5c48 2021-07-13T01:10:00.264Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8a171326-87c5-4288-a94c-1fe302a5819f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:00.664Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8a171326-87c5-4288-a94c-1fe302a5819f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=891 EndTimestamp=2021-07-13T01:10:00.664Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:09:59.773Z InvocationID=b47fa470-3caf-4308-a1db-25cd4f57cee5 ResponseDesc=OK 2021-07-13T01:10:02.869Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=850d2f57-2bba-47f7-9fce-f8e77e1e48ea InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:02.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:02.869Z InvocationID=776ee1d8-06b5-4755-bc9a-7dde1d9dd6c1 2021-07-13T01:10:03.057Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=850d2f57-2bba-47f7-9fce-f8e77e1e48ea InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:03.457Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=850d2f57-2bba-47f7-9fce-f8e77e1e48ea InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=588 EndTimestamp=2021-07-13T01:10:03.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:02.869Z InvocationID=6a928ce1-070b-4b89-80c7-913487a89895 ResponseDesc=OK 2021-07-13T01:10:05.761Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5361b827-894b-435b-a3ea-8284dfdbfe4d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:05.761Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:05.761Z InvocationID=e50fec19-369d-470a-8dbe-7756cef6152c 2021-07-13T01:10:05.863Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5361b827-894b-435b-a3ea-8284dfdbfe4d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:06.511Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5361b827-894b-435b-a3ea-8284dfdbfe4d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=749 EndTimestamp=2021-07-13T01:10:06.510Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:05.761Z InvocationID=4db245a4-9f82-46a5-b788-15c182243b15 ResponseDesc=OK 2021-07-13T01:10:07.448Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=471780af-3337-4e26-9ff9-879199d88818 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:07.448Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:07.448Z InvocationID=ec43438f-bcf3-4e07-9069-0af2f6900a13 2021-07-13T01:10:07.626Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=471780af-3337-4e26-9ff9-879199d88818 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:07.864Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=471780af-3337-4e26-9ff9-879199d88818 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=415 EndTimestamp=2021-07-13T01:10:07.863Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:07.448Z InvocationID=aefabd0b-76bf-4c16-bd39-e97d69a2db23 ResponseDesc=OK 2021-07-13T01:10:08.667Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4e29b449-c35d-4746-be6a-8820f85d1d39 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:08.667Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:08.667Z InvocationID=9d4795ca-f4b7-4479-8940-fcca1b4c3108 2021-07-13T01:10:08.874Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=09cf3e55-4af0-4bb8-8fc4-18033be6381d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:08.874Z InvocationID=47fedf14-4412-4fdd-ab30-64c5affb486d 2021-07-13T01:10:08.957Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4e29b449-c35d-4746-be6a-8820f85d1d39 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:09.118Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=09cf3e55-4af0-4bb8-8fc4-18033be6381d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:09.157Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4e29b449-c35d-4746-be6a-8820f85d1d39 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=490 EndTimestamp=2021-07-13T01:10:09.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:08.667Z InvocationID=c5fbd1db-876b-482d-8904-817466f4757f ResponseDesc=OK 2021-07-13T01:10:10.015Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=09cf3e55-4af0-4bb8-8fc4-18033be6381d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1141 EndTimestamp=2021-07-13T01:10:10.015Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:08.874Z InvocationID=e37cbfc1-a539-4453-ac30-552c333c799d ResponseDesc=OK 2021-07-13T01:10:11.869Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3348303d-21f7-4581-b6ac-ee60883f8446 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:11.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:11.869Z InvocationID=6f3c7a92-d58c-4acd-a8a0-b7d606cefe43 2021-07-13T01:10:12.726Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3348303d-21f7-4581-b6ac-ee60883f8446 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:12.960Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3348303d-21f7-4581-b6ac-ee60883f8446 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1091 EndTimestamp=2021-07-13T01:10:12.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:11.869Z InvocationID=eec0a113-d540-4b85-a4f9-e3d09c291092 ResponseDesc=OK 2021-07-13T01:10:14.963Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=de71de20-2685-445e-8d75-7d14891e2363 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:14.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:14.963Z InvocationID=e432ace1-778c-4c6e-ba4b-93de4a621669 2021-07-13T01:10:15.062Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=de71de20-2685-445e-8d75-7d14891e2363 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:15.458Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=de71de20-2685-445e-8d75-7d14891e2363 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=495 EndTimestamp=2021-07-13T01:10:15.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:14.963Z InvocationID=8b77090e-7108-4585-8277-fbb67b6be119 ResponseDesc=OK 2021-07-13T01:10:17.439Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=215abac9-09f8-4b0f-abbe-3858232af243 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:17.439Z InvocationID=15bccc30-7efe-4ecd-a176-a2df9bb5aefb 2021-07-13T01:10:17.465Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=215abac9-09f8-4b0f-abbe-3858232af243 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:17.666Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=215abac9-09f8-4b0f-abbe-3858232af243 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=227 EndTimestamp=2021-07-13T01:10:17.666Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:17.439Z InvocationID=427463bf-cbb0-4964-a05d-c1c25f689872 ResponseDesc=OK 2021-07-13T01:10:17.860Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4d5fd6eb-2f3e-43bf-b2e1-39d129095f55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:17.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:17.859Z InvocationID=feeb3084-0471-4be5-b0b8-a63ca742fde6 2021-07-13T01:10:18.214Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4d5fd6eb-2f3e-43bf-b2e1-39d129095f55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:18.368Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4d5fd6eb-2f3e-43bf-b2e1-39d129095f55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=509 EndTimestamp=2021-07-13T01:10:18.368Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:17.859Z InvocationID=4dac6390-67ec-4934-a731-40b7cf23fb18 ResponseDesc=OK 2021-07-13T01:10:18.874Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8f4f0277-fd19-451c-b87e-4be323c6364f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:18.874Z InvocationID=5f3fd3dd-35b7-46ae-b89f-9e8ec90b8b7e 2021-07-13T01:10:18.963Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8f4f0277-fd19-451c-b87e-4be323c6364f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:19.657Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8f4f0277-fd19-451c-b87e-4be323c6364f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=783 EndTimestamp=2021-07-13T01:10:19.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:18.874Z InvocationID=82dcb0eb-962c-459a-8f53-4516aa7ded2e ResponseDesc=OK 2021-07-13T01:10:20.863Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9deb6b37-b8ce-41cd-bf13-33fc08134253 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:20.863Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:20.863Z InvocationID=abe39210-5f05-4411-83bf-3ff1485a8c87 2021-07-13T01:10:20.958Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9deb6b37-b8ce-41cd-bf13-33fc08134253 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:21.412Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9deb6b37-b8ce-41cd-bf13-33fc08134253 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=549 EndTimestamp=2021-07-13T01:10:21.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:20.863Z InvocationID=5ebbe649-3abc-437c-b9fb-ee1070ad6baa ResponseDesc=OK 2021-07-13T01:10:23.733Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ffb08184-a6c7-4414-a7f5-db8380469db9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:23.733Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:23.733Z InvocationID=c1ae6540-8830-4c85-85f0-1f70ea143e5e 2021-07-13T01:10:24.020Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ffb08184-a6c7-4414-a7f5-db8380469db9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:24.713Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ffb08184-a6c7-4414-a7f5-db8380469db9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=980 EndTimestamp=2021-07-13T01:10:24.713Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:23.733Z InvocationID=e44ce64f-0568-4ea2-9c48-819f4f5d2bfc ResponseDesc=OK 2021-07-13T01:10:26.562Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=58cf4d8c-1871-4bf6-af68-e93294515a13 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:26.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:26.562Z InvocationID=ae1fab6e-ac12-4233-8827-7b33f3e50715 2021-07-13T01:10:26.657Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=58cf4d8c-1871-4bf6-af68-e93294515a13 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:27.060Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=58cf4d8c-1871-4bf6-af68-e93294515a13 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=497 EndTimestamp=2021-07-13T01:10:27.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:26.562Z InvocationID=8bedcc8e-9470-4f1e-8c1d-03c70cd9cabb ResponseDesc=OK 2021-07-13T01:10:27.441Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8c73d47d-96dc-4e59-9e23-0fa911d64a49 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:27.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:27.441Z InvocationID=2b438121-f943-4604-857f-70e0bc109eb7 2021-07-13T01:10:27.467Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8c73d47d-96dc-4e59-9e23-0fa911d64a49 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:27.863Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8c73d47d-96dc-4e59-9e23-0fa911d64a49 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=422 EndTimestamp=2021-07-13T01:10:27.863Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:27.441Z InvocationID=e1786fa4-8a6c-4721-a2a1-49f77f7b9bb6 ResponseDesc=OK 2021-07-13T01:10:28.874Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0ecf0009-f46f-482d-9a64-2ccc00e7b13c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:28.874Z InvocationID=e2b3c082-ac86-4b14-98c7-ad1c9538badd 2021-07-13T01:10:29.368Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0ecf0009-f46f-482d-9a64-2ccc00e7b13c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:29.563Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0ecf0009-f46f-482d-9a64-2ccc00e7b13c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=689 EndTimestamp=2021-07-13T01:10:29.563Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:28.874Z InvocationID=a665f280-d69f-4f2d-9ce3-e6970b7d1a0b ResponseDesc=OK 2021-07-13T01:10:30.067Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=92f1bf77-f055-4653-9332-3d184773fada InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:30.067Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:30.067Z InvocationID=03fef8b1-992d-4f86-a2af-67541b1bea14 2021-07-13T01:10:30.257Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=92f1bf77-f055-4653-9332-3d184773fada InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:30.963Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=92f1bf77-f055-4653-9332-3d184773fada InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=896 EndTimestamp=2021-07-13T01:10:30.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:30.067Z InvocationID=c3536a9b-5162-4769-afca-41b8a45183e6 ResponseDesc=OK 2021-07-13T01:10:32.670Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4210d894-e28c-49af-927a-a05d3e0ecb44 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:32.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:32.670Z InvocationID=17b4cfff-2bf1-453f-9c5e-2965db268eb1 2021-07-13T01:10:32.759Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4210d894-e28c-49af-927a-a05d3e0ecb44 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:32.965Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4210d894-e28c-49af-927a-a05d3e0ecb44 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=295 EndTimestamp=2021-07-13T01:10:32.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:32.670Z InvocationID=50160661-caea-4b3c-afad-5518e01dc100 ResponseDesc=OK 2021-07-13T01:10:35.863Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f76324a3-a19f-46d3-bcc1-3f4fff5e2b7b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:35.862Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:35.862Z InvocationID=2860afdd-d154-4ce8-98af-5a3d0bf958d7 2021-07-13T01:10:36.267Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f76324a3-a19f-46d3-bcc1-3f4fff5e2b7b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:37.260Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f76324a3-a19f-46d3-bcc1-3f4fff5e2b7b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1398 EndTimestamp=2021-07-13T01:10:37.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:35.862Z InvocationID=c7318c1d-caf0-4b32-9f7a-06cd2da6209e ResponseDesc=OK 2021-07-13T01:10:37.440Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2569d1eb-a5a9-41f2-ba09-63a220a5d519 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:37.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:37.439Z InvocationID=5d04f4cc-d8bc-4b24-b6d5-4f21a61e47e5 2021-07-13T01:10:37.557Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2569d1eb-a5a9-41f2-ba09-63a220a5d519 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:37.677Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2569d1eb-a5a9-41f2-ba09-63a220a5d519 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=238 EndTimestamp=2021-07-13T01:10:37.677Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:37.439Z InvocationID=e00a6f42-8b2b-46c1-9976-d2ef9f95b609 ResponseDesc=OK 2021-07-13T01:10:38.763Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5ec0d6e-3cb2-4baa-9f86-6be610182912 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:38.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:38.763Z InvocationID=f2c68553-51ac-47e1-ad7b-e1b032d96e78 2021-07-13T01:10:38.784Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5ec0d6e-3cb2-4baa-9f86-6be610182912 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:38.875Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0c68c937-a832-49b0-90d2-197ced1f723f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:38.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:38.875Z InvocationID=8feb8a3a-0f87-46cd-9a37-9d7a75e20713 2021-07-13T01:10:38.962Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0c68c937-a832-49b0-90d2-197ced1f723f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:39.068Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0c68c937-a832-49b0-90d2-197ced1f723f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=193 EndTimestamp=2021-07-13T01:10:39.068Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:38.875Z InvocationID=f0fd8ae9-dac4-4c0a-ba0f-839d23976394 ResponseDesc=OK 2021-07-13T01:10:39.168Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f5ec0d6e-3cb2-4baa-9f86-6be610182912 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=405 EndTimestamp=2021-07-13T01:10:39.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:38.763Z InvocationID=6417c007-ecc0-4dab-9634-ba9973b49da5 ResponseDesc=OK 2021-07-13T01:10:41.878Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7b1cce84-7af7-4a7a-8378-bd18c6076347 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:41.877Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:41.877Z InvocationID=12d6d084-5d6a-48da-b88c-2617eb00b756 2021-07-13T01:10:42.156Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7b1cce84-7af7-4a7a-8378-bd18c6076347 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:42.366Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7b1cce84-7af7-4a7a-8378-bd18c6076347 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=489 EndTimestamp=2021-07-13T01:10:42.366Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:41.877Z InvocationID=e745a341-894f-45f7-9b25-8b779ac78cc0 ResponseDesc=OK 2021-07-13T01:10:44.869Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d736b03e-e4af-4525-90d8-9b9be3ff36aa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:44.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:44.868Z InvocationID=3e5e6502-9b23-4f56-8fae-e3a27389386b 2021-07-13T01:10:44.964Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d736b03e-e4af-4525-90d8-9b9be3ff36aa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:45.165Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d736b03e-e4af-4525-90d8-9b9be3ff36aa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=297 EndTimestamp=2021-07-13T01:10:45.165Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:44.868Z InvocationID=50c30607-a82f-4e47-8a3d-e3354253eda6 ResponseDesc=OK 2021-07-13T01:10:47.443Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a49884c9-e493-4a96-b07b-1e3082d3c40f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:47.443Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:47.443Z InvocationID=60bf0682-9d91-496f-af68-90b56d3747a9 2021-07-13T01:10:47.560Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a49884c9-e493-4a96-b07b-1e3082d3c40f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:47.772Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=69e72447-79f4-42d2-8d2b-5a55ca77a0bb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:47.772Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:47.772Z InvocationID=36f6972a-f6e4-424b-9062-1c880413bf74 2021-07-13T01:10:47.863Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a49884c9-e493-4a96-b07b-1e3082d3c40f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=420 EndTimestamp=2021-07-13T01:10:47.863Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:47.443Z InvocationID=e2aa2297-a7a5-48ed-8b4c-226770ec9996 ResponseDesc=OK 2021-07-13T01:10:47.961Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=69e72447-79f4-42d2-8d2b-5a55ca77a0bb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:48.559Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=69e72447-79f4-42d2-8d2b-5a55ca77a0bb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=787 EndTimestamp=2021-07-13T01:10:48.559Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:47.772Z InvocationID=805cfb0b-8e2b-451f-9f06-2efd0c55b5d1 ResponseDesc=OK 2021-07-13T01:10:48.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f007e66c-d2e2-4ce1-9592-dba563ff139e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:48.874Z InvocationID=d32ac1b0-f3aa-4967-9486-1618f7c4c363 2021-07-13T01:10:49.059Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f007e66c-d2e2-4ce1-9592-dba563ff139e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:49.814Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f007e66c-d2e2-4ce1-9592-dba563ff139e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=940 EndTimestamp=2021-07-13T01:10:49.814Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:48.874Z InvocationID=7c390714-9f36-4207-8f61-ecbacbdd4112 ResponseDesc=OK 2021-07-13T01:10:50.871Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2185c828-75d1-457d-877a-ec5780d507a7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:50.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:50.871Z InvocationID=313f2970-7982-4752-ac77-2e86612d9aa8 2021-07-13T01:10:51.718Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2185c828-75d1-457d-877a-ec5780d507a7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:52.059Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2185c828-75d1-457d-877a-ec5780d507a7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1188 EndTimestamp=2021-07-13T01:10:52.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:50.871Z InvocationID=33dc11dd-4995-4d7f-80fc-2df751b9c947 ResponseDesc=OK 2021-07-13T01:10:53.763Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=993159ca-1b62-40f8-9df1-326c61a68e22 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:53.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:53.763Z InvocationID=75238db8-2a38-4348-9c45-01eefde063e3 2021-07-13T01:10:53.858Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=993159ca-1b62-40f8-9df1-326c61a68e22 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:54.857Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=993159ca-1b62-40f8-9df1-326c61a68e22 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1094 EndTimestamp=2021-07-13T01:10:54.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:53.763Z InvocationID=7757647a-71b6-4ca2-952d-26f369ed5fa4 ResponseDesc=OK 2021-07-13T01:10:56.768Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=29d2d6a2-ffdf-409e-82fb-2b33f2860df6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:56.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:56.768Z InvocationID=0e7c33cb-a6fb-4d61-923d-a8b9d596d4a3 2021-07-13T01:10:56.860Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=29d2d6a2-ffdf-409e-82fb-2b33f2860df6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:57.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=35029e7d-a191-4875-b149-97012ed74f26 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:57.440Z InvocationID=366317ee-4488-4ed8-ba9b-9027b8d055f9 2021-07-13T01:10:57.962Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=35029e7d-a191-4875-b149-97012ed74f26 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:57.963Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=29d2d6a2-ffdf-409e-82fb-2b33f2860df6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1195 EndTimestamp=2021-07-13T01:10:57.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:56.768Z InvocationID=03a9971b-fd34-44db-a429-2beeb8fa586c ResponseDesc=OK 2021-07-13T01:10:58.160Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=35029e7d-a191-4875-b149-97012ed74f26 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=720 EndTimestamp=2021-07-13T01:10:58.160Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:57.440Z InvocationID=67c2dfe4-22db-4768-9845-99885f21b6de ResponseDesc=OK 2021-07-13T01:10:58.874Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9bb19504-403e-4e61-8b5b-2b3cb48e2738 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:58.874Z InvocationID=e3130f9b-39d7-418c-8e27-605e40273dd0 2021-07-13T01:10:59.064Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9bb19504-403e-4e61-8b5b-2b3cb48e2738 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:10:59.457Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9bb19504-403e-4e61-8b5b-2b3cb48e2738 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=583 EndTimestamp=2021-07-13T01:10:59.457Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:58.874Z InvocationID=a5e556c0-d053-4e1b-9ef0-66b2336931f7 ResponseDesc=OK 2021-07-13T01:10:59.976Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81c50484-9ab6-4d66-add4-adc1f7dd81e0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:10:59.976Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:59.976Z InvocationID=d99c17f6-0da2-4fac-85dd-b88984d00d55 2021-07-13T01:11:00.060Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81c50484-9ab6-4d66-add4-adc1f7dd81e0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:00.321Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=81c50484-9ab6-4d66-add4-adc1f7dd81e0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=345 EndTimestamp=2021-07-13T01:11:00.321Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:10:59.976Z InvocationID=ab4af9f0-f1cd-42f1-8b11-c34abe295d12 ResponseDesc=OK 2021-07-13T01:11:02.868Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0dbc6020-51de-4f51-aa39-7e608b71428d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:02.868Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:02.868Z InvocationID=8eba3668-eaa1-4a03-842e-2db32cb3526c 2021-07-13T01:11:03.022Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0dbc6020-51de-4f51-aa39-7e608b71428d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:03.116Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0dbc6020-51de-4f51-aa39-7e608b71428d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=248 EndTimestamp=2021-07-13T01:11:03.116Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:02.868Z InvocationID=49059610-af1f-42a9-a303-4fc385a84b8c ResponseDesc=OK 2021-07-13T01:11:06.060Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9e1f21f8-5810-4d0e-9b0a-c266265554e2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:06.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:06.060Z InvocationID=47633ef6-efbe-4f64-bee9-706b7d993990 2021-07-13T01:11:06.157Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9e1f21f8-5810-4d0e-9b0a-c266265554e2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:06.557Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9e1f21f8-5810-4d0e-9b0a-c266265554e2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=497 EndTimestamp=2021-07-13T01:11:06.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:06.060Z InvocationID=d4d77c17-0a32-42fa-81d4-cb54d35cebe7 ResponseDesc=OK 2021-07-13T01:11:07.446Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e20b78b6-84cd-4094-9a84-eba79860f024 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:07.446Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:07.446Z InvocationID=a53942ce-db2c-4a32-b051-6563f9110cdf 2021-07-13T01:11:07.559Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e20b78b6-84cd-4094-9a84-eba79860f024 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:08.744Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e20b78b6-84cd-4094-9a84-eba79860f024 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1298 EndTimestamp=2021-07-13T01:11:08.744Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:07.446Z InvocationID=851239ac-251a-4e9b-9cae-36bdcf2378c2 ResponseDesc=OK 2021-07-13T01:11:08.875Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=477d21c7-abed-491a-91c7-8bd773e59b51 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:08.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:08.875Z InvocationID=9ef72e67-eed4-4fbd-9194-02072c55a62f 2021-07-13T01:11:10.582Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=477d21c7-abed-491a-91c7-8bd773e59b51 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:10.760Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=477d21c7-abed-491a-91c7-8bd773e59b51 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1885 EndTimestamp=2021-07-13T01:11:10.760Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:08.875Z InvocationID=e82212bf-408b-4e3b-b0c0-3de3e8c65493 ResponseDesc=OK 2021-07-13T01:11:11.025Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1784de89-0e92-4ae6-843b-e188a679a6e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:11.024Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:11.024Z InvocationID=bc5a21e1-8eb7-488a-8a59-49837e851f4f 2021-07-13T01:11:11.456Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1784de89-0e92-4ae6-843b-e188a679a6e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:11.662Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1784de89-0e92-4ae6-843b-e188a679a6e8 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=637 EndTimestamp=2021-07-13T01:11:11.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:11.024Z InvocationID=29ea3eda-81a2-45f1-9d57-b7432a1bed17 ResponseDesc=OK 2021-07-13T01:11:12.671Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ee13b716-17d8-4db2-b2f9-bdae6e3ef27a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:12.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:12.671Z InvocationID=6b2d56d9-5d40-4035-85d6-4a8d9d2607d1 2021-07-13T01:11:12.760Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ee13b716-17d8-4db2-b2f9-bdae6e3ef27a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:13.227Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ee13b716-17d8-4db2-b2f9-bdae6e3ef27a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=556 EndTimestamp=2021-07-13T01:11:13.227Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:12.671Z InvocationID=0249d502-9e3b-4a42-9716-c4904659a776 ResponseDesc=OK 2021-07-13T01:11:15.261Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f2fcbfa9-bea9-445f-8510-83120b24a3a9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:15.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:15.261Z InvocationID=d9177983-3097-4e59-958c-4f7afe589671 2021-07-13T01:11:15.419Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f2fcbfa9-bea9-445f-8510-83120b24a3a9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:15.660Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f2fcbfa9-bea9-445f-8510-83120b24a3a9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=398 EndTimestamp=2021-07-13T01:11:15.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:15.261Z InvocationID=bdb4310a-ed7e-48f3-9f11-af0f603d2a8f ResponseDesc=OK 2021-07-13T01:11:17.441Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=29970330-86a7-429e-855e-818338979fb1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:17.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:17.441Z InvocationID=a6d1639f-235c-43d4-8120-d5504e7d4766 2021-07-13T01:11:17.656Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=29970330-86a7-429e-855e-818338979fb1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:17.965Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=84e17b46-8dce-40b7-97ee-09cedafd90cb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:17.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:17.965Z InvocationID=cbab911f-099d-4f38-9d71-c0dc7b3bb389 2021-07-13T01:11:18.065Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=84e17b46-8dce-40b7-97ee-09cedafd90cb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:18.458Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=84e17b46-8dce-40b7-97ee-09cedafd90cb InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=493 EndTimestamp=2021-07-13T01:11:18.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:17.965Z InvocationID=a0d90e0c-4354-4bc9-ad11-5ff53ac6123d ResponseDesc=OK 2021-07-13T01:11:18.627Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=29970330-86a7-429e-855e-818338979fb1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1186 EndTimestamp=2021-07-13T01:11:18.627Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:17.441Z InvocationID=4d1affab-123f-40b3-9725-ad0f56dd0f7a ResponseDesc=OK 2021-07-13T01:11:18.874Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=53a2280e-6e59-4de0-9231-a340e0a6a3a0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:18.874Z InvocationID=2f2942d9-2314-47ca-b556-1dcecd67ff7a 2021-07-13T01:11:19.712Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=53a2280e-6e59-4de0-9231-a340e0a6a3a0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:19.961Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=53a2280e-6e59-4de0-9231-a340e0a6a3a0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1087 EndTimestamp=2021-07-13T01:11:19.961Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:18.874Z InvocationID=6e38e3e0-41f6-4c76-8374-603e7c128547 ResponseDesc=OK 2021-07-13T01:11:20.574Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fc46d5df-b58d-4c9a-8956-09067850df9a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:20.574Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:20.574Z InvocationID=70603730-7b1c-4250-a173-875cab58d06b 2021-07-13T01:11:20.724Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fc46d5df-b58d-4c9a-8956-09067850df9a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:21.057Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fc46d5df-b58d-4c9a-8956-09067850df9a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=483 EndTimestamp=2021-07-13T01:11:21.057Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:20.574Z InvocationID=c133a7b9-571d-4010-8f0f-72b993412640 ResponseDesc=OK 2021-07-13T01:11:23.669Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da32e34d-91d5-4d08-85e2-067c5643fce3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:23.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:23.669Z InvocationID=d657934e-b45f-4f05-8c78-a319eab950b4 2021-07-13T01:11:23.858Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da32e34d-91d5-4d08-85e2-067c5643fce3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:24.116Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da32e34d-91d5-4d08-85e2-067c5643fce3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=447 EndTimestamp=2021-07-13T01:11:24.116Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:23.669Z InvocationID=8905ebc7-3835-4680-afba-acd036a76e3a ResponseDesc=OK 2021-07-13T01:11:26.971Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1840013b-4c1f-4ab4-bc7b-ad160170ffe5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:26.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:26.971Z InvocationID=c8f72d30-6efa-4b0a-b219-77f2754e6932 2021-07-13T01:11:27.264Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1840013b-4c1f-4ab4-bc7b-ad160170ffe5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:27.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=85e205c8-a65e-451e-bc44-abe985f9fc6c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:27.440Z InvocationID=eb2997bb-ae6a-43cb-bda6-bce62d15f703 2021-07-13T01:11:27.461Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1840013b-4c1f-4ab4-bc7b-ad160170ffe5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=489 EndTimestamp=2021-07-13T01:11:27.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:26.971Z InvocationID=1506765f-c7ad-44ff-a35d-c53e7413b48e ResponseDesc=OK 2021-07-13T01:11:27.557Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=85e205c8-a65e-451e-bc44-abe985f9fc6c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:27.857Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=85e205c8-a65e-451e-bc44-abe985f9fc6c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=417 EndTimestamp=2021-07-13T01:11:27.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:27.440Z InvocationID=3cb73ac7-bbf2-4e95-8183-87bc0d854683 ResponseDesc=OK 2021-07-13T01:11:28.874Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=be0b9666-13a1-4069-b176-1696074fcf2a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:28.874Z InvocationID=86784a91-cd96-4357-863a-53e1810fafef 2021-07-13T01:11:29.059Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=be0b9666-13a1-4069-b176-1696074fcf2a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:29.964Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=be0b9666-13a1-4069-b176-1696074fcf2a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1090 EndTimestamp=2021-07-13T01:11:29.964Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:28.874Z InvocationID=2f6229b6-02c9-4103-bbc1-2b48070d9eb7 ResponseDesc=OK 2021-07-13T01:11:30.025Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3899e601-b022-4c49-bf4f-3f23a88ea829 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:30.025Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:30.025Z InvocationID=e1749f11-83ac-4cb4-acfa-738fce5ac774 2021-07-13T01:11:30.223Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3899e601-b022-4c49-bf4f-3f23a88ea829 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:30.660Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3899e601-b022-4c49-bf4f-3f23a88ea829 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=635 EndTimestamp=2021-07-13T01:11:30.660Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:30.025Z InvocationID=c055ea71-3736-4c76-a34b-36b9eabf9c09 ResponseDesc=OK 2021-07-13T01:11:32.770Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2a4930b5-bf08-4258-b8d7-e4003bc81a68 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:32.769Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:32.769Z InvocationID=affcf45b-815c-4bbd-afbc-6a23ffa235bd 2021-07-13T01:11:33.056Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2a4930b5-bf08-4258-b8d7-e4003bc81a68 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:33.458Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2a4930b5-bf08-4258-b8d7-e4003bc81a68 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=689 EndTimestamp=2021-07-13T01:11:33.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:32.769Z InvocationID=07d98f90-eebc-4f0c-b9a6-35b2237a0e5e ResponseDesc=OK 2021-07-13T01:11:36.060Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cd9cb879-0527-4a97-bb27-ee3c6cd7ed58 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:36.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:36.060Z InvocationID=453f365d-2ba8-4206-a6e5-bf8620f3fbc4 2021-07-13T01:11:36.259Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cd9cb879-0527-4a97-bb27-ee3c6cd7ed58 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:36.663Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cd9cb879-0527-4a97-bb27-ee3c6cd7ed58 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=603 EndTimestamp=2021-07-13T01:11:36.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:36.060Z InvocationID=36b3e40a-d1d0-457d-8778-3d721b46d804 ResponseDesc=OK 2021-07-13T01:11:37.444Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a0be2b3e-0d72-4826-8eef-af8c289d321a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:37.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:37.444Z InvocationID=997b7aa6-5fcc-435d-8468-199836baa60d 2021-07-13T01:11:37.614Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a0be2b3e-0d72-4826-8eef-af8c289d321a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:37.960Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a0be2b3e-0d72-4826-8eef-af8c289d321a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=516 EndTimestamp=2021-07-13T01:11:37.960Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:37.444Z InvocationID=2d658ec8-32f4-497a-9371-055de76d4412 ResponseDesc=OK 2021-07-13T01:11:38.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=2f1b4018-1b8e-4d40-872d-ea4a5c13baff InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:38.874Z InvocationID=0d759e14-fb4b-4d3c-b31f-ae00854e1b68 2021-07-13T01:11:39.080Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=38a3e1e1-cd5d-4c96-a05d-7b53a688ab55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:39.080Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:39.080Z InvocationID=5729379b-17bc-46bc-8bdf-f7492b8976e3 2021-07-13T01:11:39.658Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=2f1b4018-1b8e-4d40-872d-ea4a5c13baff InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:40.458Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=38a3e1e1-cd5d-4c96-a05d-7b53a688ab55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:40.657Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=2f1b4018-1b8e-4d40-872d-ea4a5c13baff InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1783 EndTimestamp=2021-07-13T01:11:40.657Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:38.874Z InvocationID=e1652291-3705-40c8-8037-6c4ed8353da8 ResponseDesc=OK 2021-07-13T01:11:40.670Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=38a3e1e1-cd5d-4c96-a05d-7b53a688ab55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1590 EndTimestamp=2021-07-13T01:11:40.670Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:39.080Z InvocationID=94fbc0d5-b665-45b0-b6ec-812702f1ce7d ResponseDesc=OK 2021-07-13T01:11:41.567Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a7006fb3-5d87-4acc-bf7e-e7e6a5d7ba90 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:41.567Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:41.567Z InvocationID=a9a7af10-df1a-4eb9-a4b7-d619422dac5a 2021-07-13T01:11:42.115Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a7006fb3-5d87-4acc-bf7e-e7e6a5d7ba90 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:42.360Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a7006fb3-5d87-4acc-bf7e-e7e6a5d7ba90 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=793 EndTimestamp=2021-07-13T01:11:42.360Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:41.567Z InvocationID=e30b8373-69a5-454e-a1b7-15d1c0f2c502 ResponseDesc=OK 2021-07-13T01:11:45.060Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fe4bea47-69fc-4c06-b670-7e196ed8d1f6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:45.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:45.060Z InvocationID=2f8982c7-395b-4e23-b6ec-b1345620abfd 2021-07-13T01:11:45.156Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fe4bea47-69fc-4c06-b670-7e196ed8d1f6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:45.362Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fe4bea47-69fc-4c06-b670-7e196ed8d1f6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=301 EndTimestamp=2021-07-13T01:11:45.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:45.060Z InvocationID=a4740065-e460-45ca-bbd8-57a11ee21a7f ResponseDesc=OK 2021-07-13T01:11:47.440Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8d3d8704-82b4-40b4-9d77-b1312be35bcf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:47.440Z InvocationID=7502945f-3a8b-4177-b344-f18b53081119 2021-07-13T01:11:47.559Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8d3d8704-82b4-40b4-9d77-b1312be35bcf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:48.061Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8d3d8704-82b4-40b4-9d77-b1312be35bcf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=621 EndTimestamp=2021-07-13T01:11:48.061Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:47.440Z InvocationID=9ce922c1-6827-4799-b164-215eca73d54c ResponseDesc=OK 2021-07-13T01:11:48.261Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=932f3867-d04e-4ec2-bc46-abecf4f3266b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:48.261Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:48.261Z InvocationID=17dba147-ec38-4558-8f66-a8f4908de450 2021-07-13T01:11:48.378Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=932f3867-d04e-4ec2-bc46-abecf4f3266b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:48.874Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=36a2e3d6-4a67-44ed-a587-232a9fd9d960 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:48.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:48.874Z InvocationID=2b0a25eb-6370-4cf2-92a1-322ca161e68a 2021-07-13T01:11:48.961Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=932f3867-d04e-4ec2-bc46-abecf4f3266b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=700 EndTimestamp=2021-07-13T01:11:48.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:48.261Z InvocationID=bab8374c-f8f9-43d3-b110-f6cc79c6898e ResponseDesc=OK 2021-07-13T01:11:49.057Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=36a2e3d6-4a67-44ed-a587-232a9fd9d960 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:49.459Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=36a2e3d6-4a67-44ed-a587-232a9fd9d960 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=584 EndTimestamp=2021-07-13T01:11:49.458Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:48.874Z InvocationID=43b161cd-d691-43ec-aff3-cce20d37043f ResponseDesc=OK 2021-07-13T01:11:51.061Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=33e0d23e-f41b-42c5-9611-d7325c0a67b0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:51.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:51.061Z InvocationID=9ee031b7-f65d-4eae-ac83-6027a23033bc 2021-07-13T01:11:51.159Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=33e0d23e-f41b-42c5-9611-d7325c0a67b0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:51.362Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=33e0d23e-f41b-42c5-9611-d7325c0a67b0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=301 EndTimestamp=2021-07-13T01:11:51.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:51.061Z InvocationID=7d207476-c2a9-481c-9591-ae90f60aadac ResponseDesc=OK 2021-07-13T01:11:53.460Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8e8a61ec-3597-41f4-867e-7c23d3219333 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:53.460Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:53.460Z InvocationID=6e18f4ed-45f2-4e22-8d46-780ec242ecde 2021-07-13T01:11:53.475Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8e8a61ec-3597-41f4-867e-7c23d3219333 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:53.661Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8e8a61ec-3597-41f4-867e-7c23d3219333 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=201 EndTimestamp=2021-07-13T01:11:53.661Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:53.460Z InvocationID=efc87206-2e27-4f81-9e24-c68730c0f63b ResponseDesc=OK 2021-07-13T01:11:56.766Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a7994de7-c045-478e-94c4-d6b4730ee74b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:56.765Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:56.765Z InvocationID=9ab2c2e2-4c00-42d3-81df-eac746aac971 2021-07-13T01:11:56.863Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a7994de7-c045-478e-94c4-d6b4730ee74b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:57.357Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a7994de7-c045-478e-94c4-d6b4730ee74b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=592 EndTimestamp=2021-07-13T01:11:57.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:56.765Z InvocationID=68cc4d4f-ca3f-41f5-9934-3032630fb607 ResponseDesc=OK 2021-07-13T01:11:57.439Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a78f2601-3588-4477-9745-ab16e621de35 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:57.439Z InvocationID=07a31d9f-1b43-42fd-812e-515997af2980 2021-07-13T01:11:57.474Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a78f2601-3588-4477-9745-ab16e621de35 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:11:57.818Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a78f2601-3588-4477-9745-ab16e621de35 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=379 EndTimestamp=2021-07-13T01:11:57.818Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:57.439Z InvocationID=d29d1ded-ade5-4e5b-ae6f-b6643874d9f9 ResponseDesc=OK 2021-07-13T01:11:58.874Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=aadfa588-a42a-4384-80b4-a8ac481b539a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:11:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:58.874Z InvocationID=2a5f38d7-c913-47ee-a93d-afdc67db9a39 2021-07-13T01:12:00.116Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=aadfa588-a42a-4384-80b4-a8ac481b539a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:00.360Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=aadfa588-a42a-4384-80b4-a8ac481b539a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1486 EndTimestamp=2021-07-13T01:12:00.360Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:11:58.874Z InvocationID=53b6ed26-cc17-46ad-96ac-f1d98ba3c5ef ResponseDesc=OK 2021-07-13T01:12:00.630Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=79a0e0d3-708f-47de-a2a3-780526e6ec80 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:00.630Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:00.630Z InvocationID=656f4b5a-729c-44f7-8952-3ade79519b53 2021-07-13T01:12:00.757Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=79a0e0d3-708f-47de-a2a3-780526e6ec80 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:01.257Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=79a0e0d3-708f-47de-a2a3-780526e6ec80 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=627 EndTimestamp=2021-07-13T01:12:01.257Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:00.630Z InvocationID=9b61e6b2-d09c-4853-8dec-622cb49ca0cf ResponseDesc=OK 2021-07-13T01:12:02.571Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dc1e3a9a-ea51-4955-8e16-623218d17c48 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:02.571Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:02.571Z InvocationID=342a993e-cd1c-4309-a5ca-800fb40170a1 2021-07-13T01:12:02.759Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dc1e3a9a-ea51-4955-8e16-623218d17c48 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:03.121Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dc1e3a9a-ea51-4955-8e16-623218d17c48 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=550 EndTimestamp=2021-07-13T01:12:03.121Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:02.571Z InvocationID=18f2ab41-f74f-427e-a771-eef607f4a4de ResponseDesc=OK 2021-07-13T01:12:06.064Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=38505cc8-cb12-4647-90db-54afe46a3d56 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:06.064Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:06.064Z InvocationID=569c742b-50e7-4ec0-aa51-c14324a54cfc 2021-07-13T01:12:06.316Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=38505cc8-cb12-4647-90db-54afe46a3d56 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:06.560Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=38505cc8-cb12-4647-90db-54afe46a3d56 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=496 EndTimestamp=2021-07-13T01:12:06.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:06.064Z InvocationID=4ee3c055-c419-4893-8bb6-53925c0fcb7a ResponseDesc=OK 2021-07-13T01:12:07.440Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=af977e0e-cda4-4dcd-92c6-758605527995 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:07.439Z InvocationID=434f49f3-a483-4034-ba49-f97de17a2e17 2021-07-13T01:12:07.557Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=af977e0e-cda4-4dcd-92c6-758605527995 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:07.857Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=af977e0e-cda4-4dcd-92c6-758605527995 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=418 EndTimestamp=2021-07-13T01:12:07.857Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:07.439Z InvocationID=8394a0c7-baee-4e1c-a7a8-0c425f77edc5 ResponseDesc=OK 2021-07-13T01:12:08.875Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b8b8819e-fd9a-4a93-aae9-c3ea26ca94d2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:08.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:08.875Z InvocationID=bbb62ab2-62ec-4f90-ae61-7e5d5c12f7a2 2021-07-13T01:12:08.961Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b8b8819e-fd9a-4a93-aae9-c3ea26ca94d2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:09.019Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eaa6ccaf-4ce2-4661-a6e5-e3b1e1bc0d19 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:09.019Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:09.019Z InvocationID=d1571bb3-cf6d-4a3d-b082-f05bebfd607f 2021-07-13T01:12:09.716Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eaa6ccaf-4ce2-4661-a6e5-e3b1e1bc0d19 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:09.935Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b8b8819e-fd9a-4a93-aae9-c3ea26ca94d2 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1060 EndTimestamp=2021-07-13T01:12:09.935Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:08.875Z InvocationID=285e17a8-bd7d-44b2-8c0b-b5569b831ff8 ResponseDesc=OK 2021-07-13T01:12:09.959Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eaa6ccaf-4ce2-4661-a6e5-e3b1e1bc0d19 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=940 EndTimestamp=2021-07-13T01:12:09.959Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:09.019Z InvocationID=e4a3cd9e-a839-4762-b137-53633ac05310 ResponseDesc=OK 2021-07-13T01:12:11.872Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9df13328-ad9d-4959-af98-5ef255f50e0f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:11.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:11.871Z InvocationID=f07f30e6-de6f-40fd-89b8-24c3bb9da614 2021-07-13T01:12:12.056Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9df13328-ad9d-4959-af98-5ef255f50e0f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:12.357Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9df13328-ad9d-4959-af98-5ef255f50e0f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=486 EndTimestamp=2021-07-13T01:12:12.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:11.871Z InvocationID=76fd4b47-8db7-4e42-9791-fa6d041ae0ac ResponseDesc=OK 2021-07-13T01:12:14.670Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a9235362-9511-4123-ad7d-bb3cba1d4da7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:14.669Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:14.669Z InvocationID=5aa123e8-a947-4d3d-85b2-9c7208059bc5 2021-07-13T01:12:15.159Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a9235362-9511-4123-ad7d-bb3cba1d4da7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:15.363Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a9235362-9511-4123-ad7d-bb3cba1d4da7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=693 EndTimestamp=2021-07-13T01:12:15.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:14.669Z InvocationID=27ebf6c3-4b41-4365-bf76-4c05f9488815 ResponseDesc=OK 2021-07-13T01:12:17.444Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5872b54b-fc0d-4c15-9c33-00e6ffc1819b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:17.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:17.444Z InvocationID=6b556941-72c2-4346-9f05-0d4e52c93c7a 2021-07-13T01:12:17.614Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5872b54b-fc0d-4c15-9c33-00e6ffc1819b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:17.773Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5872b54b-fc0d-4c15-9c33-00e6ffc1819b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=328 EndTimestamp=2021-07-13T01:12:17.772Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:17.444Z InvocationID=4b91b7da-3981-4dd0-b542-b7802bae25af ResponseDesc=OK 2021-07-13T01:12:17.871Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f7f4142a-56a1-4105-bfd1-da54ca75ac57 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:17.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:17.871Z InvocationID=11ed444e-77a9-4640-ac38-551b6cd819d1 2021-07-13T01:12:18.156Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f7f4142a-56a1-4105-bfd1-da54ca75ac57 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:18.458Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f7f4142a-56a1-4105-bfd1-da54ca75ac57 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=587 EndTimestamp=2021-07-13T01:12:18.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:17.871Z InvocationID=11f79be9-f8b0-4bd5-94d7-71767416d5a7 ResponseDesc=OK 2021-07-13T01:12:18.874Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e00f2185-e875-4958-9f3a-03dbeb8106cf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:18.874Z InvocationID=81fe0209-48fc-4639-9f3b-c741bd1a85a7 2021-07-13T01:12:18.960Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e00f2185-e875-4958-9f3a-03dbeb8106cf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:19.213Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e00f2185-e875-4958-9f3a-03dbeb8106cf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=339 EndTimestamp=2021-07-13T01:12:19.213Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:18.874Z InvocationID=1fe01591-35c4-449f-b589-43adeff3f9c0 ResponseDesc=OK 2021-07-13T01:12:20.965Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=90a89069-f1be-46bb-8d1f-f9518ea746fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:20.965Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:20.965Z InvocationID=9c180b58-d033-4a21-ad23-685dd6c1126d 2021-07-13T01:12:21.715Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=90a89069-f1be-46bb-8d1f-f9518ea746fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:21.960Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=90a89069-f1be-46bb-8d1f-f9518ea746fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=995 EndTimestamp=2021-07-13T01:12:21.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:20.965Z InvocationID=d112bfcd-0d55-454b-9b15-81d311c147e3 ResponseDesc=OK 2021-07-13T01:12:24.069Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f5335681-501d-4a99-b50a-b8fac1f0491a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:24.069Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:24.069Z InvocationID=eda9e8d0-4a07-4fd6-97ec-5691a5747174 2021-07-13T01:12:24.384Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f5335681-501d-4a99-b50a-b8fac1f0491a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:24.657Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f5335681-501d-4a99-b50a-b8fac1f0491a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=588 EndTimestamp=2021-07-13T01:12:24.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:24.069Z InvocationID=413f84e2-c63e-4801-b824-c4a0a2106c63 ResponseDesc=OK 2021-07-13T01:12:26.659Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6dbe6903-942b-4f2b-a92f-3d1abff16d85 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:26.659Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:26.659Z InvocationID=b1434e26-ed69-4c7a-bc6d-7e136bffcf53 2021-07-13T01:12:26.684Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6dbe6903-942b-4f2b-a92f-3d1abff16d85 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:27.313Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6dbe6903-942b-4f2b-a92f-3d1abff16d85 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=654 EndTimestamp=2021-07-13T01:12:27.313Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:26.659Z InvocationID=ac1b3d8f-1968-4f78-ada8-66590f2fcbdd ResponseDesc=OK 2021-07-13T01:12:27.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7eb9258e-b09e-4127-bdcb-8c93707fd72d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:27.440Z InvocationID=70069f7b-3dce-4aa3-b0c9-976c8fef8596 2021-07-13T01:12:27.613Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7eb9258e-b09e-4127-bdcb-8c93707fd72d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:27.860Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7eb9258e-b09e-4127-bdcb-8c93707fd72d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=420 EndTimestamp=2021-07-13T01:12:27.860Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:27.440Z InvocationID=0b079a96-fc34-4a9a-924a-06271b25b6cb ResponseDesc=OK 2021-07-13T01:12:28.875Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=13c13dbb-eed4-4434-a3a3-c59d0fe55eb0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:28.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:28.875Z InvocationID=15c0d10b-7b9a-4c80-a7a5-f99c03d7b1c7 2021-07-13T01:12:29.156Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=13c13dbb-eed4-4434-a3a3-c59d0fe55eb0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:29.757Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=13c13dbb-eed4-4434-a3a3-c59d0fe55eb0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=882 EndTimestamp=2021-07-13T01:12:29.757Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:28.875Z InvocationID=30f11e61-0d8e-4b09-b29d-c7d18b005ebf ResponseDesc=OK 2021-07-13T01:12:30.344Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=44020153-1d37-4e60-8a3b-58ae885734a1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:30.343Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:30.343Z InvocationID=d140c363-b3ac-428a-8c64-bb90026b5724 2021-07-13T01:12:32.958Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=44020153-1d37-4e60-8a3b-58ae885734a1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:33.319Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=44020153-1d37-4e60-8a3b-58ae885734a1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2976 EndTimestamp=2021-07-13T01:12:33.319Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:30.343Z InvocationID=2d763718-a764-48d8-933e-9c22ef3eea08 ResponseDesc=OK 2021-07-13T01:12:35.032Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d0823e80-09cc-472c-b172-28b0596b3171 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:35.031Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:35.031Z InvocationID=1e18a01b-e767-4848-a801-50219a874f2d 2021-07-13T01:12:35.234Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d0823e80-09cc-472c-b172-28b0596b3171 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:35.462Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d0823e80-09cc-472c-b172-28b0596b3171 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=431 EndTimestamp=2021-07-13T01:12:35.462Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:35.031Z InvocationID=8ca61175-b668-4130-8194-215a9973a91f ResponseDesc=OK 2021-07-13T01:12:36.219Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=95362b25-633b-4db7-987b-353969c9ffed InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:36.219Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:36.219Z InvocationID=75195c17-0920-4377-be7e-51ec849c3031 2021-07-13T01:12:36.456Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=95362b25-633b-4db7-987b-353969c9ffed InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:36.858Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=95362b25-633b-4db7-987b-353969c9ffed InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=638 EndTimestamp=2021-07-13T01:12:36.857Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:36.219Z InvocationID=f4a8b4ae-f595-466d-aafe-eab1ca218ca7 ResponseDesc=OK 2021-07-13T01:12:37.441Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=114ab854-cf74-412c-96e5-97ab98f204ba InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:37.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:37.441Z InvocationID=066c101c-f41f-4e87-a7ab-60695635d499 2021-07-13T01:12:37.559Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=114ab854-cf74-412c-96e5-97ab98f204ba InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:38.873Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=197d367a-45d6-4040-a590-ceebbb9526c7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:38.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:38.873Z InvocationID=137883bf-3ec8-410e-a4d2-48f50cc50a7d 2021-07-13T01:12:38.919Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=114ab854-cf74-412c-96e5-97ab98f204ba InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1478 EndTimestamp=2021-07-13T01:12:38.919Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:37.441Z InvocationID=c1aaf370-ca32-44a2-b5b4-3a8a76f587a2 ResponseDesc=OK 2021-07-13T01:12:39.333Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1cc2b6af-2b23-4bd7-a8f4-4188dd3dc1c3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:39.333Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:39.333Z InvocationID=0d6792c6-f90e-4cdc-9665-e3e8493c213b 2021-07-13T01:12:39.560Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1cc2b6af-2b23-4bd7-a8f4-4188dd3dc1c3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:39.562Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=197d367a-45d6-4040-a590-ceebbb9526c7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:40.260Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1cc2b6af-2b23-4bd7-a8f4-4188dd3dc1c3 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=927 EndTimestamp=2021-07-13T01:12:40.260Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:39.333Z InvocationID=49734b64-cda2-4b6d-9d2b-2657c7cecf8f ResponseDesc=OK 2021-07-13T01:12:40.365Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=197d367a-45d6-4040-a590-ceebbb9526c7 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1492 EndTimestamp=2021-07-13T01:12:40.365Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:38.873Z InvocationID=1a69f254-1f5d-4ae7-b67d-c1b35fbf52b7 ResponseDesc=OK 2021-07-13T01:12:41.671Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=29574bb1-0177-446e-8814-3dc6be2ca87d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:41.671Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:41.671Z InvocationID=4d2d0fc8-539b-4dad-b555-61a2b105b50f 2021-07-13T01:12:41.760Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=29574bb1-0177-446e-8814-3dc6be2ca87d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:41.971Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=29574bb1-0177-446e-8814-3dc6be2ca87d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=300 EndTimestamp=2021-07-13T01:12:41.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:41.671Z InvocationID=eec76a91-64d4-4c0b-982a-494d85c724d4 ResponseDesc=OK 2021-07-13T01:12:44.669Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f0ca5e83-0b5d-4d65-b03e-e87a42276b05 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:44.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:44.668Z InvocationID=c3c3314b-4973-46f5-b215-cb5675ccad03 2021-07-13T01:12:44.815Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f0ca5e83-0b5d-4d65-b03e-e87a42276b05 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:45.060Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f0ca5e83-0b5d-4d65-b03e-e87a42276b05 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=392 EndTimestamp=2021-07-13T01:12:45.060Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:44.668Z InvocationID=fd7d7243-e661-4e60-9dab-510d8d23aaa8 ResponseDesc=OK 2021-07-13T01:12:47.440Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c471e708-dab5-4034-861f-8e8ae8a7e017 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:47.440Z InvocationID=5e12d908-f1da-4f4d-a6bc-4d660abe1fb7 2021-07-13T01:12:47.557Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c471e708-dab5-4034-861f-8e8ae8a7e017 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:47.870Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=375627a3-f889-4610-bdc0-a07cfcb50fbe InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:47.870Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:47.870Z InvocationID=9d2e29da-abee-4e76-be41-d6269087805d 2021-07-13T01:12:48.060Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=375627a3-f889-4610-bdc0-a07cfcb50fbe InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:48.362Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c471e708-dab5-4034-861f-8e8ae8a7e017 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=922 EndTimestamp=2021-07-13T01:12:48.362Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:47.440Z InvocationID=46ee3acc-ca11-49bb-9917-0b432aa171e6 ResponseDesc=OK 2021-07-13T01:12:48.434Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=375627a3-f889-4610-bdc0-a07cfcb50fbe InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=564 EndTimestamp=2021-07-13T01:12:48.434Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:47.870Z InvocationID=a4ce1d79-6aaf-40e3-8162-b9d8569f6e9f ResponseDesc=OK 2021-07-13T01:12:48.873Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e1961368-7b7c-42fb-bc16-298390ba9c1f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:48.873Z InvocationID=41a525df-a0a4-41cc-a6bd-db700f7e9e25 2021-07-13T01:12:49.062Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e1961368-7b7c-42fb-bc16-298390ba9c1f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:49.260Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e1961368-7b7c-42fb-bc16-298390ba9c1f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=386 EndTimestamp=2021-07-13T01:12:49.259Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:48.873Z InvocationID=8f2d9da3-00a0-47b6-b529-6ffa47fdbdaf ResponseDesc=OK 2021-07-13T01:12:52.126Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c3771810-43bf-4f86-9d4e-ffee132aff15 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:52.126Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:52.126Z InvocationID=5f442210-f7a0-450d-841a-c9b1041dc148 2021-07-13T01:12:52.256Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c3771810-43bf-4f86-9d4e-ffee132aff15 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:52.960Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c3771810-43bf-4f86-9d4e-ffee132aff15 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=834 EndTimestamp=2021-07-13T01:12:52.960Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:52.126Z InvocationID=4994231f-c5e7-4d15-be10-47d7607ae671 ResponseDesc=OK 2021-07-13T01:12:56.416Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8c2c9a7f-8616-40c5-8a75-46ea93d5a41a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:56.416Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:56.416Z InvocationID=7a19c299-97bb-4e9b-bef0-5936177452a6 2021-07-13T01:12:56.559Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8c2c9a7f-8616-40c5-8a75-46ea93d5a41a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:56.812Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8c2c9a7f-8616-40c5-8a75-46ea93d5a41a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=396 EndTimestamp=2021-07-13T01:12:56.812Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:56.416Z InvocationID=9bbaf1f3-a7ae-4964-a501-a2a9859b377a ResponseDesc=OK 2021-07-13T01:12:57.439Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81750aad-0101-45a2-abac-089496b633fe InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:57.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:57.439Z InvocationID=6124ac4a-e9d9-4b26-b3a5-89e9bab7bf4c 2021-07-13T01:12:57.615Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81750aad-0101-45a2-abac-089496b633fe InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:57.859Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=81750aad-0101-45a2-abac-089496b633fe InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=420 EndTimestamp=2021-07-13T01:12:57.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:57.439Z InvocationID=8e413f61-a1de-48f3-afa1-1e33eaacd868 ResponseDesc=OK 2021-07-13T01:12:57.930Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=df1b0d2c-778a-490c-a8d0-ec0d1f16a466 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:57.930Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:57.930Z InvocationID=372457ef-b2ae-434e-a33a-12235d22182a 2021-07-13T01:12:58.056Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=df1b0d2c-778a-490c-a8d0-ec0d1f16a466 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:58.458Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=df1b0d2c-778a-490c-a8d0-ec0d1f16a466 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=528 EndTimestamp=2021-07-13T01:12:58.458Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:57.930Z InvocationID=e66b553e-5f54-46a3-a58b-bd7b6639d21a ResponseDesc=OK 2021-07-13T01:12:58.874Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8ee9eff1-efc8-4308-867f-2e0c10c659a5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:58.874Z InvocationID=64f55fb3-061b-4f85-b469-03aa3cc8bb99 2021-07-13T01:12:59.059Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8ee9eff1-efc8-4308-867f-2e0c10c659a5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:12:59.611Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8ee9eff1-efc8-4308-867f-2e0c10c659a5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=737 EndTimestamp=2021-07-13T01:12:59.611Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:58.874Z InvocationID=d5141bca-8f63-4c2b-afae-e5c28cae0868 ResponseDesc=OK 2021-07-13T01:12:59.668Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d31493d7-8984-4051-9db9-55ea27041ae6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:12:59.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:59.668Z InvocationID=2e986b0b-84dc-4ed7-b92a-6eed849ec23d 2021-07-13T01:12:59.914Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d31493d7-8984-4051-9db9-55ea27041ae6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:00.159Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d31493d7-8984-4051-9db9-55ea27041ae6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=491 EndTimestamp=2021-07-13T01:13:00.159Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:12:59.668Z InvocationID=6c817f6c-6339-4aad-abb3-0b3f2da08d9b ResponseDesc=OK 2021-07-13T01:13:02.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7eea935a-203e-4fd8-9c37-57bfc302092b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:02.874Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:02.874Z InvocationID=be906e39-ebdf-43d2-89de-0e1426c5a092 2021-07-13T01:13:03.156Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7eea935a-203e-4fd8-9c37-57bfc302092b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:03.557Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7eea935a-203e-4fd8-9c37-57bfc302092b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=683 EndTimestamp=2021-07-13T01:13:03.557Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:02.874Z InvocationID=be43f94b-332a-4738-816d-9378f842e651 ResponseDesc=OK 2021-07-13T01:13:05.962Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9a86e7f7-301f-441d-bf8d-228daf4a3159 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:05.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:05.962Z InvocationID=08225f54-63a7-42ab-a2cc-a45071e0a334 2021-07-13T01:13:05.971Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9a86e7f7-301f-441d-bf8d-228daf4a3159 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:06.272Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9a86e7f7-301f-441d-bf8d-228daf4a3159 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=309 EndTimestamp=2021-07-13T01:13:06.271Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:05.962Z InvocationID=cd9899e6-2c2b-4afd-81e7-6f369d237875 ResponseDesc=OK 2021-07-13T01:13:07.441Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=bba205ca-6e00-425b-b225-04f27265b61f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:07.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:07.441Z InvocationID=c3eefc7b-ca5a-4b55-9130-2ce32aee6ee5 2021-07-13T01:13:07.487Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=bba205ca-6e00-425b-b225-04f27265b61f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:07.661Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=bba205ca-6e00-425b-b225-04f27265b61f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=220 EndTimestamp=2021-07-13T01:13:07.661Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:07.441Z InvocationID=db8e2ecb-31fb-4de6-8920-1e89a1749625 ResponseDesc=OK 2021-07-13T01:13:08.875Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5ee50316-be45-4477-9b1e-a3ae717351c9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:08.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:08.875Z InvocationID=5598aed5-23de-42b1-a8e7-22d32ae94ad8 2021-07-13T01:13:08.961Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f9eddf76-10d6-49d7-8f52-91e029fb18f9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:08.961Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:08.961Z InvocationID=7f0d1c7f-a60f-41b9-b983-3e074ba6601d 2021-07-13T01:13:09.058Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5ee50316-be45-4477-9b1e-a3ae717351c9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:09.073Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f9eddf76-10d6-49d7-8f52-91e029fb18f9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:09.260Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5ee50316-be45-4477-9b1e-a3ae717351c9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=385 EndTimestamp=2021-07-13T01:13:09.260Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:08.875Z InvocationID=6d5aedf1-992c-4e5b-8085-22b1dc007114 ResponseDesc=OK 2021-07-13T01:13:09.562Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f9eddf76-10d6-49d7-8f52-91e029fb18f9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=601 EndTimestamp=2021-07-13T01:13:09.562Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:08.961Z InvocationID=1b27bc2e-8101-413e-8593-5a07f952f893 ResponseDesc=OK 2021-07-13T01:13:11.968Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=852f0810-3dfc-431a-9a88-71b878823b56 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:11.968Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:11.968Z InvocationID=0dabc874-2207-4574-9880-eb9602ccf601 2021-07-13T01:13:12.467Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=852f0810-3dfc-431a-9a88-71b878823b56 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:12.574Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=852f0810-3dfc-431a-9a88-71b878823b56 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=606 EndTimestamp=2021-07-13T01:13:12.574Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:11.968Z InvocationID=ab08de13-f74b-4740-ac17-275bbc788e0b ResponseDesc=OK 2021-07-13T01:13:14.966Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e590cdc3-954f-4c6a-9a27-312bbbf7410f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:14.966Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:14.966Z InvocationID=b7426a95-989a-4686-8865-d4b54813c4e0 2021-07-13T01:13:15.257Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e590cdc3-954f-4c6a-9a27-312bbbf7410f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:15.558Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e590cdc3-954f-4c6a-9a27-312bbbf7410f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=592 EndTimestamp=2021-07-13T01:13:15.558Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:14.966Z InvocationID=fd40bffc-998d-4e31-a750-172cac3114c1 ResponseDesc=OK 2021-07-13T01:13:17.439Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fb70e550-d312-4f82-880a-c045527a6be4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:17.439Z InvocationID=920d2c6e-8e02-4f32-84d5-df38bb801388 2021-07-13T01:13:17.491Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fb70e550-d312-4f82-880a-c045527a6be4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:17.670Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fb70e550-d312-4f82-880a-c045527a6be4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=231 EndTimestamp=2021-07-13T01:13:17.670Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:17.439Z InvocationID=5c3e4033-b49b-450f-9ac6-7d195d539fd9 ResponseDesc=OK 2021-07-13T01:13:17.672Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=84834cee-84ab-4cb6-8753-c49306b3f178 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:17.672Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:17.672Z InvocationID=c53f7ed8-2392-423b-9a97-738de9dc4357 2021-07-13T01:13:17.766Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=84834cee-84ab-4cb6-8753-c49306b3f178 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:17.860Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=84834cee-84ab-4cb6-8753-c49306b3f178 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=187 EndTimestamp=2021-07-13T01:13:17.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:17.672Z InvocationID=6e82b7ec-f4b8-4851-b5a8-cda1a381d766 ResponseDesc=OK 2021-07-13T01:13:18.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ce6c6fd4-bc27-48c2-b67b-2908556d2a55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:18.874Z InvocationID=e7523289-db6a-406a-b8e4-786b6ddd77e0 2021-07-13T01:13:18.963Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ce6c6fd4-bc27-48c2-b67b-2908556d2a55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:21.357Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ce6c6fd4-bc27-48c2-b67b-2908556d2a55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2483 EndTimestamp=2021-07-13T01:13:21.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:18.874Z InvocationID=1b8a24ca-9fd0-4ae1-83a8-6db8eaf7d3d4 ResponseDesc=OK 2021-07-13T01:13:21.703Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=44c18ef4-4ab2-4199-ba1e-32fe285eec81 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:21.703Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:21.703Z InvocationID=48ccdde4-b849-4b70-b944-d5de56420a5b 2021-07-13T01:13:21.868Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=44c18ef4-4ab2-4199-ba1e-32fe285eec81 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:22.319Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=44c18ef4-4ab2-4199-ba1e-32fe285eec81 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=616 EndTimestamp=2021-07-13T01:13:22.319Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:21.703Z InvocationID=e0a050b0-27e1-43cd-930d-dd77d5b86219 ResponseDesc=OK 2021-07-13T01:13:23.665Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1cf0b258-f551-41bd-bac2-653b5119663c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:23.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:23.665Z InvocationID=1e780f95-0292-4baa-b676-d54f0af84d00 2021-07-13T01:13:23.767Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1cf0b258-f551-41bd-bac2-653b5119663c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:23.871Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1cf0b258-f551-41bd-bac2-653b5119663c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=206 EndTimestamp=2021-07-13T01:13:23.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:23.665Z InvocationID=7bd8d9e4-d853-44b3-ae42-91e8be0a04dc ResponseDesc=OK 2021-07-13T01:13:26.473Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5cb9040d-5e71-44be-a4b7-ecebaad041b5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:26.473Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:26.473Z InvocationID=b4f455b3-715d-4248-8c88-b8ed65465274 2021-07-13T01:13:27.057Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5cb9040d-5e71-44be-a4b7-ecebaad041b5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:27.441Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=da3b82e0-0057-44bb-809d-7cebd898d4fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:27.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:27.440Z InvocationID=d901b13a-224d-4a66-b634-86c57d7e1c07 2021-07-13T01:13:27.562Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=da3b82e0-0057-44bb-809d-7cebd898d4fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:27.666Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5cb9040d-5e71-44be-a4b7-ecebaad041b5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1193 EndTimestamp=2021-07-13T01:13:27.666Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:26.473Z InvocationID=e6a79a85-3c59-4ff9-a0f3-921285cbedaa ResponseDesc=OK 2021-07-13T01:13:27.915Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=da3b82e0-0057-44bb-809d-7cebd898d4fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=475 EndTimestamp=2021-07-13T01:13:27.915Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:27.440Z InvocationID=6a57036c-9871-4616-ac0c-817e0d34de3f ResponseDesc=OK 2021-07-13T01:13:28.875Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=07b4589d-9794-4e5c-8754-688cfcab80a4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:28.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:28.875Z InvocationID=c8a57310-9fbd-41d2-a976-e3fff245a214 2021-07-13T01:13:29.115Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=07b4589d-9794-4e5c-8754-688cfcab80a4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:29.363Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=07b4589d-9794-4e5c-8754-688cfcab80a4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=488 EndTimestamp=2021-07-13T01:13:29.363Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:28.875Z InvocationID=cd6a5d03-3bb2-41a1-9d61-0557d4ca48b5 ResponseDesc=OK 2021-07-13T01:13:29.972Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=36f66084-b494-41dc-8db9-bebf0c5cd35d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:29.972Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:29.972Z InvocationID=d7afe6a2-9e14-4ad3-ae0b-81bdf16d74dc 2021-07-13T01:13:30.157Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=36f66084-b494-41dc-8db9-bebf0c5cd35d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:30.858Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=36f66084-b494-41dc-8db9-bebf0c5cd35d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=886 EndTimestamp=2021-07-13T01:13:30.858Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:29.972Z InvocationID=03eee220-ad78-4adf-afa2-3c0ee47a6ae8 ResponseDesc=OK 2021-07-13T01:13:32.663Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3d6b2a49-71f7-49a7-b23e-b4978679ff84 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:32.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:32.662Z InvocationID=8acc86c1-d327-4e5a-95c5-b6e23968262c 2021-07-13T01:13:32.759Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3d6b2a49-71f7-49a7-b23e-b4978679ff84 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:33.517Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3d6b2a49-71f7-49a7-b23e-b4978679ff84 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=855 EndTimestamp=2021-07-13T01:13:33.517Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:32.662Z InvocationID=c994aee0-aba7-4a74-8aa0-0211ef26a148 ResponseDesc=OK 2021-07-13T01:13:35.963Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=24f8082a-381e-4ddc-8609-4fa1de3f4cc0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:35.963Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:35.963Z InvocationID=93c929ba-abf7-4eb3-9c9c-0e9f6ac3b9af 2021-07-13T01:13:36.116Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=24f8082a-381e-4ddc-8609-4fa1de3f4cc0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:36.459Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=24f8082a-381e-4ddc-8609-4fa1de3f4cc0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=496 EndTimestamp=2021-07-13T01:13:36.459Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:35.963Z InvocationID=311e21c9-e4c8-4f26-aa0d-ac98561364c5 ResponseDesc=OK 2021-07-13T01:13:37.440Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81b0980c-5cd0-4f0b-84ba-173fda08280a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:37.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:37.440Z InvocationID=5a5b55ec-3ef3-4a33-953a-3a8c6baaf511 2021-07-13T01:13:37.556Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81b0980c-5cd0-4f0b-84ba-173fda08280a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:37.858Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=81b0980c-5cd0-4f0b-84ba-173fda08280a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=418 EndTimestamp=2021-07-13T01:13:37.858Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:37.440Z InvocationID=d28b6d24-4e31-4f94-a3a7-9b84215fcedd ResponseDesc=OK 2021-07-13T01:13:38.768Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0f18fe1d-f79a-4e8d-b00c-ca35ca53bf55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:38.768Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:38.768Z InvocationID=dd32ecd5-7989-4bb4-a5bb-8c25362b5690 2021-07-13T01:13:38.874Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=d32def9a-bb73-4e1a-9249-86c30dae76be InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:38.874Z InvocationID=d55737b4-d30a-46d4-9938-a906ff6d5dec 2021-07-13T01:13:38.958Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0f18fe1d-f79a-4e8d-b00c-ca35ca53bf55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:39.057Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=d32def9a-bb73-4e1a-9249-86c30dae76be InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:39.361Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0f18fe1d-f79a-4e8d-b00c-ca35ca53bf55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=593 EndTimestamp=2021-07-13T01:13:39.361Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:38.768Z InvocationID=29e1ecc5-01f0-40c7-bce5-83c2ef237479 ResponseDesc=OK 2021-07-13T01:13:39.412Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=d32def9a-bb73-4e1a-9249-86c30dae76be InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=538 EndTimestamp=2021-07-13T01:13:39.412Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:38.874Z InvocationID=1b0944af-5124-48f6-8769-1c4fb60e5343 ResponseDesc=OK 2021-07-13T01:13:41.763Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=086dc32e-35b3-41f9-b1a5-abe08f370182 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:41.763Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:41.763Z InvocationID=c105ad2f-6df6-436f-a46d-b291b2f12211 2021-07-13T01:13:41.956Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=086dc32e-35b3-41f9-b1a5-abe08f370182 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:42.357Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=086dc32e-35b3-41f9-b1a5-abe08f370182 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=594 EndTimestamp=2021-07-13T01:13:42.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:41.763Z InvocationID=17e6d5d6-e21c-429c-abc6-ce9b250a5190 ResponseDesc=OK 2021-07-13T01:13:45.164Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=11bb9688-a67e-4629-b40e-1289fc0ee12f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:45.164Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:45.164Z InvocationID=4e831dd7-0d42-4253-a508-86573ad59174 2021-07-13T01:13:45.362Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=11bb9688-a67e-4629-b40e-1289fc0ee12f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:45.717Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=11bb9688-a67e-4629-b40e-1289fc0ee12f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=553 EndTimestamp=2021-07-13T01:13:45.717Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:45.164Z InvocationID=e5dedfbe-c160-4c5d-bc6e-b0e16aca8c39 ResponseDesc=OK 2021-07-13T01:13:47.439Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=86773870-f27a-440a-b191-43894bc06e19 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:47.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:47.439Z InvocationID=e020039d-77b9-497b-828e-b8b01bf62aff 2021-07-13T01:13:47.635Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=86773870-f27a-440a-b191-43894bc06e19 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:47.762Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=07a762e1-9f35-42c9-b0c3-0282ef593375 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:47.762Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:47.762Z InvocationID=54d16054-20d1-4901-a8b6-df4c436b02a9 2021-07-13T01:13:47.860Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=86773870-f27a-440a-b191-43894bc06e19 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=420 EndTimestamp=2021-07-13T01:13:47.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:47.439Z InvocationID=b0a4bb6f-838d-4a6d-aad3-33f302b08fe3 ResponseDesc=OK 2021-07-13T01:13:47.961Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=07a762e1-9f35-42c9-b0c3-0282ef593375 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:48.358Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=07a762e1-9f35-42c9-b0c3-0282ef593375 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=596 EndTimestamp=2021-07-13T01:13:48.358Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:47.762Z InvocationID=4baa4956-12eb-43e6-8cee-f0529660e250 ResponseDesc=OK 2021-07-13T01:13:48.875Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=b9ff0955-b053-49a2-8ae6-1fd35fb608bf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:48.875Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:48.875Z InvocationID=6351ae8b-bb6f-464d-bfc4-187724cbd9d8 2021-07-13T01:13:49.059Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=b9ff0955-b053-49a2-8ae6-1fd35fb608bf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:49.327Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=b9ff0955-b053-49a2-8ae6-1fd35fb608bf InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=452 EndTimestamp=2021-07-13T01:13:49.327Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:48.875Z InvocationID=bf902ae4-ac20-4110-be9c-d0f4e01791da ResponseDesc=OK 2021-07-13T01:13:50.668Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ae0c02a1-c117-4b02-9fa8-65abd9386693 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:50.668Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:50.668Z InvocationID=8598e378-9231-4226-9636-12adf857de8a 2021-07-13T01:13:51.173Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ae0c02a1-c117-4b02-9fa8-65abd9386693 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:51.278Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ae0c02a1-c117-4b02-9fa8-65abd9386693 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=610 EndTimestamp=2021-07-13T01:13:51.278Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:50.668Z InvocationID=bafd7935-e33d-47eb-8879-feba9dfe92a0 ResponseDesc=OK 2021-07-13T01:13:53.681Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fb06d733-30ac-483b-8c16-9b3d1e683d9e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:53.680Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:53.680Z InvocationID=d6fb252f-ada7-46ed-aae3-784946ce4e80 2021-07-13T01:13:55.858Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fb06d733-30ac-483b-8c16-9b3d1e683d9e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:56.659Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fb06d733-30ac-483b-8c16-9b3d1e683d9e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2978 EndTimestamp=2021-07-13T01:13:56.658Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:53.680Z InvocationID=898a682a-2a7c-4bbf-84ea-7dc94341ea07 ResponseDesc=OK 2021-07-13T01:13:57.441Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8d57020b-b295-4557-8b6f-b7b3d7d5924e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:57.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:57.441Z InvocationID=ac999c36-27c9-42a4-8f89-e4552f98e1eb 2021-07-13T01:13:57.560Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8d57020b-b295-4557-8b6f-b7b3d7d5924e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:57.618Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c4100932-2447-42bd-b572-db961d9484dc InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:57.618Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:57.618Z InvocationID=e6d509c0-9eb5-46cc-b3af-c547a373a578 2021-07-13T01:13:57.815Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c4100932-2447-42bd-b572-db961d9484dc InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:58.362Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c4100932-2447-42bd-b572-db961d9484dc InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=744 EndTimestamp=2021-07-13T01:13:58.362Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:57.618Z InvocationID=77542eb8-9b07-4d12-bcc2-17dd9254d081 ResponseDesc=OK 2021-07-13T01:13:58.417Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8d57020b-b295-4557-8b6f-b7b3d7d5924e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=976 EndTimestamp=2021-07-13T01:13:58.417Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:57.441Z InvocationID=aa053c26-49b7-4f47-b840-140c6b8a6778 ResponseDesc=OK 2021-07-13T01:13:58.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=e1801fab-83dd-4102-a299-850a8e29d457 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:58.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:58.874Z InvocationID=003b5e73-c33f-448e-b0be-b82195c79952 2021-07-13T01:13:59.057Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=e1801fab-83dd-4102-a299-850a8e29d457 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:13:59.458Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=e1801fab-83dd-4102-a299-850a8e29d457 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=584 EndTimestamp=2021-07-13T01:13:59.458Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:58.874Z InvocationID=87f0b4c5-caa3-475a-bc89-fed51643634e ResponseDesc=OK 2021-07-13T01:13:59.770Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=41c050c1-3935-4726-9d2c-29a6d8d83048 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:13:59.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:59.770Z InvocationID=fed0a075-1cd7-45e1-b4e0-3109aab562ea 2021-07-13T01:13:59.860Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=41c050c1-3935-4726-9d2c-29a6d8d83048 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:00.018Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=41c050c1-3935-4726-9d2c-29a6d8d83048 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=248 EndTimestamp=2021-07-13T01:14:00.018Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:13:59.770Z InvocationID=e08f4e82-174b-42d9-a7ab-5d7b4b340d8b ResponseDesc=OK 2021-07-13T01:14:03.068Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7343b916-652e-4a8f-bf0a-96f499455157 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:03.068Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:03.068Z InvocationID=134a5432-8ea7-4d9e-a171-4c9929a51b00 2021-07-13T01:14:03.811Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7343b916-652e-4a8f-bf0a-96f499455157 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:04.060Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7343b916-652e-4a8f-bf0a-96f499455157 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=991 EndTimestamp=2021-07-13T01:14:04.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:03.068Z InvocationID=ffa881fa-a976-4c0d-8a77-a31ed4ca2d73 ResponseDesc=OK 2021-07-13T01:14:06.062Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=584a0418-1b90-4852-abd3-28b9bd5c7858 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:06.062Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:06.062Z InvocationID=3a46b357-2d90-4889-b339-7c8437a62f10 2021-07-13T01:14:06.156Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=584a0418-1b90-4852-abd3-28b9bd5c7858 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:06.457Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=584a0418-1b90-4852-abd3-28b9bd5c7858 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=395 EndTimestamp=2021-07-13T01:14:06.457Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:06.062Z InvocationID=f659788e-b2b3-4bb4-abd0-c6e69ee51d30 ResponseDesc=OK 2021-07-13T01:14:07.439Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a6b528d4-6312-4ec4-bce3-05adbb088332 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:07.439Z InvocationID=b599a3e8-c269-4eb8-bc64-4e77bf9cf451 2021-07-13T01:14:07.559Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a6b528d4-6312-4ec4-bce3-05adbb088332 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:07.978Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a6b528d4-6312-4ec4-bce3-05adbb088332 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=539 EndTimestamp=2021-07-13T01:14:07.978Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:07.439Z InvocationID=08414673-4c76-41a5-bac3-78bbdd1dbdcc ResponseDesc=OK 2021-07-13T01:14:08.662Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cff2e651-cab1-434d-ae57-66d0ad0c5e6c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:08.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:08.662Z InvocationID=3a0cc423-3e95-4dc8-9a11-814e13d3a727 2021-07-13T01:14:08.873Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3e0d8d54-ea85-4343-8d93-dec7545c26fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:08.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:08.873Z InvocationID=f7e49f70-c1c6-43b5-97c6-6c671354b7d1 2021-07-13T01:14:09.659Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3e0d8d54-ea85-4343-8d93-dec7545c26fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:10.161Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3e0d8d54-ea85-4343-8d93-dec7545c26fd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1288 EndTimestamp=2021-07-13T01:14:10.161Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:08.873Z InvocationID=89b470aa-d028-45ac-8931-ba27e8d110cd ResponseDesc=OK 2021-07-13T01:14:10.216Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cff2e651-cab1-434d-ae57-66d0ad0c5e6c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:10.770Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cff2e651-cab1-434d-ae57-66d0ad0c5e6c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=2108 EndTimestamp=2021-07-13T01:14:10.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:08.662Z InvocationID=3240178b-a37f-4da3-a86f-97a760fc56af ResponseDesc=OK 2021-07-13T01:14:11.874Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=464eb99c-7beb-4e8b-a3ba-7d0236e6323d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:11.874Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:11.874Z InvocationID=62ec39d1-cb3c-43c0-a076-75bab7d35759 2021-07-13T01:14:11.961Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=464eb99c-7beb-4e8b-a3ba-7d0236e6323d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:12.715Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=464eb99c-7beb-4e8b-a3ba-7d0236e6323d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=841 EndTimestamp=2021-07-13T01:14:12.715Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:11.874Z InvocationID=d8caa0c9-d6f3-4782-bb75-635cf9c4b1b8 ResponseDesc=OK 2021-07-13T01:14:14.770Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=eba1aba0-5e88-4031-8a2b-954401fb1ced InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:14.770Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:14.770Z InvocationID=8aea508f-f204-4084-8110-f4eb8dafe13a 2021-07-13T01:14:15.834Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=eba1aba0-5e88-4031-8a2b-954401fb1ced InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:16.061Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=eba1aba0-5e88-4031-8a2b-954401fb1ced InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1291 EndTimestamp=2021-07-13T01:14:16.061Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:14.770Z InvocationID=c7971067-3a5f-47a3-b6db-191a0d167c14 ResponseDesc=OK 2021-07-13T01:14:17.439Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=0bd18306-f144-4d8a-9282-3a7cb0a107b5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:17.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:17.439Z InvocationID=c3e83104-bc38-4111-a627-18de7a2667fa 2021-07-13T01:14:17.557Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=0bd18306-f144-4d8a-9282-3a7cb0a107b5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:18.079Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=dae0d15e-17e3-4566-a078-886fac21a599 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:18.079Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:18.079Z InvocationID=2fff4824-d7b0-4f14-bc41-c7174ddbfba7 2021-07-13T01:14:18.360Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=dae0d15e-17e3-4566-a078-886fac21a599 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:18.875Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=40a1b426-298a-48a1-84cb-7dd56b9db21b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:18.874Z InvocationID=3790cb2b-2552-4100-9a95-14f03ecff22b 2021-07-13T01:14:18.957Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=0bd18306-f144-4d8a-9282-3a7cb0a107b5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1518 EndTimestamp=2021-07-13T01:14:18.957Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:17.439Z InvocationID=85c4c3a7-4eeb-4e15-b50a-82c142735fd1 ResponseDesc=OK 2021-07-13T01:14:19.012Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=dae0d15e-17e3-4566-a078-886fac21a599 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=933 EndTimestamp=2021-07-13T01:14:19.012Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:18.079Z InvocationID=a0fad2d8-698c-4635-bef3-e02f8232d604 ResponseDesc=OK 2021-07-13T01:14:19.168Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=40a1b426-298a-48a1-84cb-7dd56b9db21b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:19.636Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=40a1b426-298a-48a1-84cb-7dd56b9db21b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=762 EndTimestamp=2021-07-13T01:14:19.636Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:18.874Z InvocationID=079f77fb-891b-42e9-b5ea-9d6ff57e359a ResponseDesc=OK 2021-07-13T01:14:20.962Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4cd9a6f1-697b-435e-86cd-8cf31c252483 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:20.962Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:20.962Z InvocationID=2ead59a4-dbfd-4c91-a74a-e65783326b59 2021-07-13T01:14:21.057Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4cd9a6f1-697b-435e-86cd-8cf31c252483 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:22.757Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4cd9a6f1-697b-435e-86cd-8cf31c252483 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1795 EndTimestamp=2021-07-13T01:14:22.757Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:20.962Z InvocationID=c1239795-23a7-4792-aed7-174966dadc87 ResponseDesc=OK 2021-07-13T01:14:23.865Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=25b87a8a-680d-44dd-935e-7cc8659c6b55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:23.865Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:23.865Z InvocationID=63932666-9949-4f1b-b5d3-c76b21bdb901 2021-07-13T01:14:23.957Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=25b87a8a-680d-44dd-935e-7cc8659c6b55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:24.167Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=25b87a8a-680d-44dd-935e-7cc8659c6b55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=302 EndTimestamp=2021-07-13T01:14:24.167Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:23.865Z InvocationID=070b4493-f9b1-4be8-a841-ce01fa2c965b ResponseDesc=OK 2021-07-13T01:14:26.922Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cb354e50-172f-4d1e-936c-53a0cb4e48ce InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:26.922Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:26.922Z InvocationID=c5d832d6-a8cb-4610-9b59-24a102b1f01e 2021-07-13T01:14:27.122Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cb354e50-172f-4d1e-936c-53a0cb4e48ce InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:27.359Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cb354e50-172f-4d1e-936c-53a0cb4e48ce InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=437 EndTimestamp=2021-07-13T01:14:27.359Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:26.922Z InvocationID=a9857cbe-e35e-4c16-9936-ef5c051d3599 ResponseDesc=OK 2021-07-13T01:14:27.439Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6d586f12-7145-4b21-b55d-0a9a246e64c1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:27.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:27.439Z InvocationID=46a8b865-89be-4ffc-9439-2e5a722e2af9 2021-07-13T01:14:27.557Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6d586f12-7145-4b21-b55d-0a9a246e64c1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:27.961Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6d586f12-7145-4b21-b55d-0a9a246e64c1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=522 EndTimestamp=2021-07-13T01:14:27.961Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:27.439Z InvocationID=bca86c56-dbfa-4aaa-9374-9a428a7afb48 ResponseDesc=OK 2021-07-13T01:14:28.873Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=655ef291-3937-4731-a0a0-b7e76e139bf6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:28.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:28.873Z InvocationID=03254b1f-76ca-41e5-83a7-9f6b3a96dbcd 2021-07-13T01:14:28.960Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=655ef291-3937-4731-a0a0-b7e76e139bf6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:29.312Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=655ef291-3937-4731-a0a0-b7e76e139bf6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=439 EndTimestamp=2021-07-13T01:14:29.312Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:28.873Z InvocationID=724a3b0c-c410-447a-8b52-9a9c2a206424 ResponseDesc=OK 2021-07-13T01:14:29.874Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3317ee60-c473-4c0b-a53c-239c32fd1a41 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:29.874Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:29.874Z InvocationID=50b025d2-1e29-444a-b7a1-c84240392a25 2021-07-13T01:14:30.310Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3317ee60-c473-4c0b-a53c-239c32fd1a41 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:30.560Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3317ee60-c473-4c0b-a53c-239c32fd1a41 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=686 EndTimestamp=2021-07-13T01:14:30.560Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:29.874Z InvocationID=13e94367-65a8-4696-9344-cd2ca4ceef39 ResponseDesc=OK 2021-07-13T01:14:32.681Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cab197b4-6863-469c-8273-774e7d5b3c04 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:32.681Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:32.681Z InvocationID=88539828-3ad1-4114-b84d-5a7654362fb3 2021-07-13T01:14:32.857Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cab197b4-6863-469c-8273-774e7d5b3c04 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:33.860Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cab197b4-6863-469c-8273-774e7d5b3c04 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1179 EndTimestamp=2021-07-13T01:14:33.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:32.681Z InvocationID=09449792-a5f3-494f-9f42-552b712aa300 ResponseDesc=OK 2021-07-13T01:14:35.872Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=3cb849ae-1874-4f70-b8c8-2eba2a0061e5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:35.871Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:35.871Z InvocationID=b236d2d7-54a3-49c2-96ba-d1e952d180eb 2021-07-13T01:14:36.059Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=3cb849ae-1874-4f70-b8c8-2eba2a0061e5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:36.662Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=3cb849ae-1874-4f70-b8c8-2eba2a0061e5 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=791 EndTimestamp=2021-07-13T01:14:36.662Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:35.871Z InvocationID=87339e65-dc2d-4d9f-a0fa-e35ddcf58bfd ResponseDesc=OK 2021-07-13T01:14:37.441Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=836b299f-37f9-4a91-8456-68eb61c89715 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:37.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:37.441Z InvocationID=1685a04b-8f61-4c82-9b20-b5008dcbe887 2021-07-13T01:14:37.762Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=836b299f-37f9-4a91-8456-68eb61c89715 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:37.869Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=836b299f-37f9-4a91-8456-68eb61c89715 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=428 EndTimestamp=2021-07-13T01:14:37.869Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:37.441Z InvocationID=1f684d90-ce91-4efc-8e19-19447f6546ad ResponseDesc=OK 2021-07-13T01:14:38.874Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=f502a5c9-79f6-45aa-beb0-f4d780f47634 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:38.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:38.874Z InvocationID=b9ffc2f5-727d-4cf7-a4c0-301ea0e656f5 2021-07-13T01:14:38.970Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=f502a5c9-79f6-45aa-beb0-f4d780f47634 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:39.166Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=f502a5c9-79f6-45aa-beb0-f4d780f47634 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=292 EndTimestamp=2021-07-13T01:14:39.166Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:38.874Z InvocationID=a15e790d-c857-444d-9854-c50ccf24c6c6 ResponseDesc=OK 2021-07-13T01:14:39.264Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=7b4d5ee6-7eee-41c9-8b73-65a3da063887 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:39.264Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:39.264Z InvocationID=93c8110c-4972-4e64-bda2-c1fb806c03d6 2021-07-13T01:14:39.459Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=7b4d5ee6-7eee-41c9-8b73-65a3da063887 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:39.569Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=7b4d5ee6-7eee-41c9-8b73-65a3da063887 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=305 EndTimestamp=2021-07-13T01:14:39.569Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:39.264Z InvocationID=4957e076-3904-41ea-9f81-ae191f6a0604 ResponseDesc=OK 2021-07-13T01:14:41.876Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=cc2187b0-b664-414c-b3fc-4e74894f883c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:41.876Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:41.876Z InvocationID=52245253-88b8-473a-a83b-80640944948b 2021-07-13T01:14:41.960Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=cc2187b0-b664-414c-b3fc-4e74894f883c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:42.059Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=cc2187b0-b664-414c-b3fc-4e74894f883c InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=183 EndTimestamp=2021-07-13T01:14:42.059Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:41.876Z InvocationID=6c8f12db-4c3a-426a-9554-682b43e7bc19 ResponseDesc=OK 2021-07-13T01:14:45.168Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9be93ee1-a70c-4122-b37f-3037d1dd066e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:45.168Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:45.168Z InvocationID=b86b8075-d0fd-4e4c-8205-95be889ec8d1 2021-07-13T01:14:45.372Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9be93ee1-a70c-4122-b37f-3037d1dd066e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:47.440Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c6e4e684-66d1-470f-aa60-e16575dc117a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:47.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:47.440Z InvocationID=d90b7f50-9e33-44fa-8f60-6dc426342a5b 2021-07-13T01:14:48.161Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c6e4e684-66d1-470f-aa60-e16575dc117a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:48.358Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c6e4e684-66d1-470f-aa60-e16575dc117a InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=918 EndTimestamp=2021-07-13T01:14:48.358Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:47.440Z InvocationID=0cf7d1c9-d309-4ba6-87de-09c599b20ef1 ResponseDesc=OK 2021-07-13T01:14:48.412Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9be93ee1-a70c-4122-b37f-3037d1dd066e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=3244 EndTimestamp=2021-07-13T01:14:48.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:45.168Z InvocationID=da5ef715-e7d2-4594-9dbd-fc399feea7ee ResponseDesc=OK 2021-07-13T01:14:48.873Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5705828a-b0df-4b3c-876b-cd292f54811e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:48.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:48.873Z InvocationID=75e149ad-4892-4bb5-be1b-9e73eb8fd50e 2021-07-13T01:14:49.072Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5705828a-b0df-4b3c-876b-cd292f54811e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:49.165Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5705828a-b0df-4b3c-876b-cd292f54811e InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=292 EndTimestamp=2021-07-13T01:14:49.165Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:48.873Z InvocationID=f5743d1d-a522-43b4-84a2-1860549bafb5 ResponseDesc=OK 2021-07-13T01:14:49.319Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5d0ac680-de13-471b-9721-7bd630ce6e52 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:49.319Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:49.319Z InvocationID=25d70271-c7d0-4c9c-87cf-cf91edaaba7b 2021-07-13T01:14:49.460Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5d0ac680-de13-471b-9721-7bd630ce6e52 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:49.657Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5d0ac680-de13-471b-9721-7bd630ce6e52 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=338 EndTimestamp=2021-07-13T01:14:49.657Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:49.319Z InvocationID=704f40fe-99e8-490a-ae1e-9c05e749511a ResponseDesc=OK 2021-07-13T01:14:50.869Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=1bf966c1-5f2f-4d9f-8f58-049df4632e9d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:50.869Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:50.869Z InvocationID=3b4fdb5d-6201-438d-88da-eba16bc6cbe9 2021-07-13T01:14:50.958Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=1bf966c1-5f2f-4d9f-8f58-049df4632e9d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:51.178Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=1bf966c1-5f2f-4d9f-8f58-049df4632e9d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=309 EndTimestamp=2021-07-13T01:14:51.178Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:50.869Z InvocationID=97110858-b7d7-4763-bae1-667c6686cccb ResponseDesc=OK 2021-07-13T01:14:53.692Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ab1b04aa-3c76-4555-ab0a-ef33233592c6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:53.692Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:53.692Z InvocationID=3a16871b-62ef-41f6-bba4-e21bbb191d39 2021-07-13T01:14:53.964Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ab1b04aa-3c76-4555-ab0a-ef33233592c6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:54.072Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ab1b04aa-3c76-4555-ab0a-ef33233592c6 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=379 EndTimestamp=2021-07-13T01:14:54.071Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:53.692Z InvocationID=2931c8e8-8e29-41a2-aee4-0dfba96d787e ResponseDesc=OK 2021-07-13T01:14:56.666Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=73356bb0-07cf-47aa-8372-ed1cfbd1011d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:56.665Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:56.665Z InvocationID=40b3edc8-35b5-4b36-9163-e88d7a168cc0 2021-07-13T01:14:56.772Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=73356bb0-07cf-47aa-8372-ed1cfbd1011d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:57.157Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=73356bb0-07cf-47aa-8372-ed1cfbd1011d InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=492 EndTimestamp=2021-07-13T01:14:57.157Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:56.665Z InvocationID=a3f2c834-5233-4f9c-b975-b8226d8c8d10 ResponseDesc=OK 2021-07-13T01:14:57.440Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ff5386c9-4998-4eed-9165-ca39201078f9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:57.440Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:57.440Z InvocationID=cd9afed1-6c2a-480b-a4d6-f0ad2003d0d3 2021-07-13T01:14:57.466Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ff5386c9-4998-4eed-9165-ca39201078f9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:57.671Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ff5386c9-4998-4eed-9165-ca39201078f9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=231 EndTimestamp=2021-07-13T01:14:57.671Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:57.440Z InvocationID=9e078bff-8140-49fa-bcdd-3195ed4b9f46 ResponseDesc=OK 2021-07-13T01:14:58.874Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=4dde1925-5d08-4775-95b0-e60fc687f9db InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:14:58.873Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:58.873Z InvocationID=a38d14dc-baa5-449c-b397-b24cf1c8414b 2021-07-13T01:14:59.112Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=4dde1925-5d08-4775-95b0-e60fc687f9db InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:14:59.859Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=4dde1925-5d08-4775-95b0-e60fc687f9db InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=986 EndTimestamp=2021-07-13T01:14:59.859Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:14:58.873Z InvocationID=d4ba46f8-066c-4a08-8230-0435b498cac4 ResponseDesc=OK 2021-07-13T01:15:00.467Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=89696adb-c0a1-4ca4-a2f4-b2123a94ee6f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:00.467Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:00.467Z InvocationID=da8f7171-5b9a-4154-97a0-b1a4b2f6e127 2021-07-13T01:15:00.856Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=89696adb-c0a1-4ca4-a2f4-b2123a94ee6f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:01.758Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=89696adb-c0a1-4ca4-a2f4-b2123a94ee6f InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1291 EndTimestamp=2021-07-13T01:15:01.758Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:00.467Z InvocationID=3e976e95-6804-4348-b9b6-4f0cdccf6ac7 ResponseDesc=OK 2021-07-13T01:15:02.971Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=483dc1b3-ddd1-48d1-aa0a-9320678b2485 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:02.971Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:02.971Z InvocationID=3a5ca38e-66a6-479f-94e0-9578ee90d21a 2021-07-13T01:15:03.060Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=483dc1b3-ddd1-48d1-aa0a-9320678b2485 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:03.413Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=483dc1b3-ddd1-48d1-aa0a-9320678b2485 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=441 EndTimestamp=2021-07-13T01:15:03.412Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:02.971Z InvocationID=b7e4bd2c-d4f6-497d-9633-f35845ddc0c5 ResponseDesc=OK 2021-07-13T01:15:05.642Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=5dedeebd-3fea-4bcc-97f9-564778b80664 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:05.641Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:05.641Z InvocationID=a11b5382-9472-46f5-aeb3-2fdc59462954 2021-07-13T01:15:05.926Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=5dedeebd-3fea-4bcc-97f9-564778b80664 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:06.160Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=5dedeebd-3fea-4bcc-97f9-564778b80664 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=519 EndTimestamp=2021-07-13T01:15:06.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:05.641Z InvocationID=9082111e-a0be-484f-aaf5-f5fcb69941fe ResponseDesc=OK 2021-07-13T01:15:07.439Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6940b7f2-18a2-4e91-bed9-6551ae622afa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:07.439Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:07.439Z InvocationID=5c71e83c-7863-46a8-9a1c-7503e2e0c388 2021-07-13T01:15:07.557Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6940b7f2-18a2-4e91-bed9-6551ae622afa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:07.957Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6940b7f2-18a2-4e91-bed9-6551ae622afa InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=518 EndTimestamp=2021-07-13T01:15:07.957Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:07.439Z InvocationID=805f713c-ae56-428a-a63f-4f968f615c33 ResponseDesc=OK 2021-07-13T01:15:08.874Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=50a088e7-8490-4355-8074-6a4c2f370dcd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:08.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:08.874Z InvocationID=6fc36fda-2be8-4f67-a647-7f4525b89ca4 2021-07-13T01:15:08.963Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=50a088e7-8490-4355-8074-6a4c2f370dcd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:09.316Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=c165c441-fa57-4401-a394-88e5b37c3776 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:09.316Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:09.316Z InvocationID=3f08900c-c21b-493a-b4eb-5200e6a0a330 2021-07-13T01:15:09.414Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=50a088e7-8490-4355-8074-6a4c2f370dcd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=540 EndTimestamp=2021-07-13T01:15:09.414Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:08.874Z InvocationID=25b1c2cf-35d8-4eae-a0fb-9cc8259cc561 ResponseDesc=OK 2021-07-13T01:15:09.518Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=c165c441-fa57-4401-a394-88e5b37c3776 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:09.860Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=c165c441-fa57-4401-a394-88e5b37c3776 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=544 EndTimestamp=2021-07-13T01:15:09.860Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:09.316Z InvocationID=c98fbbf7-aade-4000-bc25-a5ab17dad574 ResponseDesc=OK 2021-07-13T01:15:13.018Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6853c3f0-5ce9-4276-8a2b-0b5176a2a120 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:13.018Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:13.018Z InvocationID=e7f939c9-a45b-4c40-8726-3ad62b123508 2021-07-13T01:15:13.157Z [qtp817348612-17] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6853c3f0-5ce9-4276-8a2b-0b5176a2a120 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:14.358Z [qtp817348612-17] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6853c3f0-5ce9-4276-8a2b-0b5176a2a120 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=1339 EndTimestamp=2021-07-13T01:15:14.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:13.018Z InvocationID=a9c05416-877a-4be0-b63f-c2e756e4e2b9 ResponseDesc=OK 2021-07-13T01:15:15.468Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=a20c52f9-e891-4a09-8356-4df9baa70614 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:15.468Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:15.468Z InvocationID=7083b551-dcd5-4b61-a149-0cc768681a70 2021-07-13T01:15:15.560Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=a20c52f9-e891-4a09-8356-4df9baa70614 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:15.859Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=a20c52f9-e891-4a09-8356-4df9baa70614 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=391 EndTimestamp=2021-07-13T01:15:15.859Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:15.468Z InvocationID=7dc1ef92-ef28-4a07-9dda-af54dc8cd89d ResponseDesc=OK 2021-07-13T01:15:17.444Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=09fdfcb6-a5de-4142-a4b2-5790989326d1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:17.444Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:17.444Z InvocationID=0f288c9a-967e-4c8b-a240-4f89376c1806 2021-07-13T01:15:17.517Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=750c53ad-4a20-4501-a3f6-5d13dafbfdfd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:17.517Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:17.517Z InvocationID=f401a6a2-d9cb-4407-9730-83aec2a0722e 2021-07-13T01:15:17.664Z [qtp817348612-16] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=750c53ad-4a20-4501-a3f6-5d13dafbfdfd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:17.712Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=09fdfcb6-a5de-4142-a4b2-5790989326d1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:17.861Z [qtp817348612-16] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=750c53ad-4a20-4501-a3f6-5d13dafbfdfd InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=344 EndTimestamp=2021-07-13T01:15:17.861Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:17.517Z InvocationID=500e0754-4e13-452b-a1d4-3761c4f0b0a9 ResponseDesc=OK 2021-07-13T01:15:18.357Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=09fdfcb6-a5de-4142-a4b2-5790989326d1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=913 EndTimestamp=2021-07-13T01:15:18.357Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:17.444Z InvocationID=5b8e421f-feeb-4b01-a896-e8b1f0aa6b62 ResponseDesc=OK 2021-07-13T01:15:18.875Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=8096b814-4e17-47d1-92a1-16cf5c8fb3a4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:18.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:18.874Z InvocationID=3c4aac30-7165-47c2-b7ca-a01748d31dbc 2021-07-13T01:15:19.059Z [qtp817348612-44] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=8096b814-4e17-47d1-92a1-16cf5c8fb3a4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:19.413Z [qtp817348612-44] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=8096b814-4e17-47d1-92a1-16cf5c8fb3a4 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=539 EndTimestamp=2021-07-13T01:15:19.413Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:18.874Z InvocationID=69305dac-aef6-435f-a1b1-ca034ff7a327 ResponseDesc=OK 2021-07-13T01:15:21.162Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=fda99594-4750-4a5a-a515-1a374d142e55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:21.162Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:21.162Z InvocationID=8e486085-565f-4aa8-8cbb-77ef02d9f926 2021-07-13T01:15:21.763Z [qtp817348612-49] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=fda99594-4750-4a5a-a515-1a374d142e55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:22.160Z [qtp817348612-49] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=fda99594-4750-4a5a-a515-1a374d142e55 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=998 EndTimestamp=2021-07-13T01:15:22.160Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:21.162Z InvocationID=9a2d94cb-c604-4d7d-8a74-68be35e62ab9 ResponseDesc=OK 2021-07-13T01:15:23.965Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=6fd543e6-028f-429a-9ecc-a6d7ca7fb2c9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:23.964Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:23.964Z InvocationID=f6765564-39c2-4e56-8f54-c2a8cec7dc30 2021-07-13T01:15:24.058Z [qtp817348612-12] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=6fd543e6-028f-429a-9ecc-a6d7ca7fb2c9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:24.357Z [qtp817348612-12] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=6fd543e6-028f-429a-9ecc-a6d7ca7fb2c9 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=393 EndTimestamp=2021-07-13T01:15:24.357Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:23.964Z InvocationID=bc1ea72f-9feb-4c9c-884b-3896a583d9dc ResponseDesc=OK 2021-07-13T01:15:26.663Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=9831fb94-405c-47d4-ba28-5a1824ddde6b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:26.663Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:26.663Z InvocationID=421e6535-841f-4864-a364-2c33c85e86d3 2021-07-13T01:15:26.759Z [qtp817348612-19] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=9831fb94-405c-47d4-ba28-5a1824ddde6b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:27.115Z [qtp817348612-19] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=9831fb94-405c-47d4-ba28-5a1824ddde6b InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=452 EndTimestamp=2021-07-13T01:15:27.115Z PartnerName=Apache-HttpClient/4.5.3 (Java/11.0.9.1) ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=10.242.98.212 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:26.663Z InvocationID=854f4de1-7a21-4d5d-a7d4-9e3d6800f7d4 ResponseDesc=OK 2021-07-13T01:15:27.441Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=ba33d316-96ce-498b-b87b-a3cb68eef5f1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:27.441Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:27.441Z InvocationID=abf3e0f6-8be0-4d85-bb80-302865c5c8e8 2021-07-13T01:15:27.867Z [qtp817348612-13] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=ba33d316-96ce-498b-b87b-a3cb68eef5f1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''} 2021-07-13T01:15:28.259Z [qtp817348612-13] INFO o.o.s.h.r.services.HealthCheckImpl ResponseCode=200 RequestID=ba33d316-96ce-498b-b87b-a3cb68eef5f1 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=818 EndTimestamp=2021-07-13T01:15:28.259Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:27.441Z InvocationID=bf9a216d-3089-4c60-9f56-6bbedaa658f4 ResponseDesc=OK 2021-07-13T01:15:28.874Z [qtp817348612-43] INFO o.o.s.h.r.services.HealthCheckImpl RequestID=81655992-4e8f-443f-a4b8-1b7fe12a08b0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 ElapsedTime=0 EndTimestamp=2021-07-13T01:15:28.874Z PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ClientIPAddress=172.16.10.98 StatusCode=COMPLETE ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck EntryTimestamp=2021-07-13T01:15:28.874Z InvocationID=9d65123e-1b12-4f44-bf1f-f14f7c25d02b 2021-07-13T01:15:29.057Z [qtp817348612-43] INFO c.a.z.c.l.i.ZusammenSLF4JLoggerFactoryImpl RequestID=81655992-4e8f-443f-a4b8-1b7fe12a08b0 InstanceID=90cfdc5e-d5bf-423c-a6f1-6699f5d2a615 PartnerName=kube-probe/1.18 ServerFQDN=dev-sdc-onboarding-be-6b8fd49d45-z2hbm ServerIpAddress=10.242.81.139 ServiceName=GET: /onboarding-api/v1.0/healthcheck Health info:BasicHealthInfo{moduleName='Cassandra', healthStatus=UP, description=''}